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The Institute for the Future is* an^ independent research organization, founded 
as a nonprofit corporation foi^ work^dlely in the publ^; interest. It is dedicated 
exclusivel^f to ^systematic and 'cbiQj^hensive study of the long-range future. 
The Institute's primary aims, as formulated in its Articles of Incorporation, 
«are fourfold: " - 

. . to enlarge existing unders'tanding concerning technological, environmental, 
and societal changes dnd , their long-range "consequences; to, develop new 
methodology to carry on such Jasks; to make a^ilable without discrimination 
the results of such/esearch ^nd scientiM^vanoes ,to the public; and to serve 
as^n educatic^nal and training center fo^^pted persons from business, govern- 
ment, foundations; '.and universities witnlHispect to such research activities."" 

The Institute's .research program has two major components: development of 
forecjtsting jitethods^ for the anailysis and synthesis of potential futures, and 
the appfic^rtion of such^metht>ds to tihe problems Qf society. Atnong the general 
areas of this research are the future state of ihe Union; the influence of future 
technological developments on societal trends; social indicators and tiK quality' 
of life; and long-fange urbah an^^flftRktriai pfanning. More specific topics, have 
also been exai^inetf,.such as the future of housing, plastics, computers, com- 
munications, insurance, ^education, and employee benefits. Institute research 
generally 4$ conducted by means of such futtlres-analytic techniques as the 
Delphi method, cross-im^^ct Analysis/ ^nd simulation, as well as the more 
traditional methods of physical- apd social-scier%e, research. « 
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FOREWORD 



Over the last two years, the Institute for the Future has designed, iia- 
plemented, and used a con^uter system that supports group conimunicatiori. 

> 

The heart of the system is computer program called FORUM. The present vol- 
ume desoifibes the concept 'of network <5onferencing, the specific computer sci- 
ence issues £iss6ciated'with it, and a review of applications to date* 

A companion volyme, entitled A Study of Social Effects, places 'compute? 
"conferencing within^ the/context of human interaction throvjgh electronic me- 
dia. It addresses icnore s^pecifically*the design and analyj^s of experiments, 
.the effects of teleconferencing on^groups^ the measurement of user .reactions^ 
^and the potential impact of computer conferencing as an energy sub&titute. 

This research is supported by the National^ Science Foundation under 
Crant GJ-35 326X anc^ the Advanced Research P^rojects Agency under Contract 
No.^EAltC 15 72 C 0165. 
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*See Robert Johansen, Richard H. Miller, and Jacques Vallee, "Group 
Comunication through Electronic Media", Institute for the Future, April 
1974. 
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important to note here that the design of FORUM has been influenced by this 
sharing o§ ideas with other projects and incorporates several advanced con- 
- — cepts derived from our observations of their progress. Notable .among the ef- 
forts we surveyed are those of the National Aeronautics and Space Adm^inistxa- 
_ tion .and the Office of Emergency Preparedness T^as well as the origoing video- 
conferencing work of the American Telephone & Telegijaph Company, the British 
Post Office, and the London-based Ccmmunications Studi,es Group. Bell Canada 
researchers and the Canadian Department of Communication have also contrih^- 
uted much to our understanding of the multimedia aspects of teleconferencing, 
of ..which computer-based programs like FORUM cdnstitute only one facet. 

The users of FORUM deserve much Off the credit for making the system a 
living reality. Although we cannot l*ist all their names, may they find here 
our sincere thanks. 
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l&teaeactioxi^* effort bM carodu^d if^d^incr me^t^mst^'^iml^wtiit' W 
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ter confereDcea jbaa also bMn ftasigtied ar^ / - ! \ ; r / / >VC 

^ In the coi&^e of this ^pojeot, «e tuive ImtrMd hcrif to'^r«ufe a oo^jN^t^-; 
Mt^rk In mxffp^ of a ^iadau^tal ^clii%-mik^ ^tivit^, the etruo^y- 
lag of oonf^ttftces* Frptt a cNxapiat^W^sclm^^irieiq^inti^ thie'hae ne^eeir^ 
.tated the deve^|pimt of new waya to 1^14, file etrue^ee t^t ^tltsm mtst^ : 
users to dhare thA similtaneoasly as neil as the ipr<^mmLag of temiaidf 
oriented capabilities that will nake tte machine m f^»idJ>le as po^lbli^V ' 
given today *s technology, Wxok a huinan^fi^tc^s viewpoints this has in« / 
vplved the identification of certain!, basic principles of ocMemnication in 
the computing envitonment and t^ creation of aie^iods for displaying bo4h 
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^ the contents and the dynamics of the coinmunication in meanii^ful ^ys • The 
sysp^ haa also heen designed to ada^^t to the skill of its user. 

^--^ The aim of the project from its inceptjion was to support the decision* 
maker directly. We started %rith specific probl^ of projecting and de* 
scribing future events or -environments by experts in non'^cmputer-*2^1ated 
fields and in a context in «^ich considerable prior experiencH has. been ac-^ 
quired by the Institute* B^pi on our observations of user reacticmis and 
measur^^t of the system's performance in approximate!} 3,0Q0 hours of W-*- 
line^ experience, have graduidly expanded the scope Jot ^plications^ under . 
consideration.. As a result, the version of the ^IRDM program now being 
used cm ARPAHST is quite adaptable in terms of the structure of t&e comaai** 
nications activities it wil^. suj^rt. 

The^ long4range goal of the teleconferencing ^oject at the Insti^te 
is tftie develofii^ent of a g^r^p ccmmunications tool based on computers cienc^ 
concepts-* . Our \futu^e work will center on the implementation of ^ full«-scale 
conferencing system, expanding on the FOIOIt^ experience, as *descri)>ed here, 

^ and utilizing tlie major findings* of this (pilot Effort* ' . 
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INTRODUCTION TO COMPUTER CONFERENCING 



Descriptions of advanced societies by science-fiction writers and tech* 
nical fexperts alike have familiarized us with thf^'^^v < '^t of coiranunication 
sysl^s vdiich are not bound by the constraints » e ^id space. A coninon 

feature of these systems is a method for instant idea exchange between peo- 
ple separated by large distances. Not only can one individual communicate 
wi'th another, ^t groups can be brought into conferences b^ transpor^ng the 
image^g or thoughts of the individual participants rather than their ^ysi- 
cal bodies*' ^ ^ 

Recent rfDtacast^pf industry trends agree Vith this concept and project 
important social effects. Electronic meeting.s would permit radical changes 
in wo^ patterns and would sMter the office environment significantly. In a 
1971 study of broadband information services to the home, Paul Bar an noted: 

4 

"...going to a place of work where physical goods are transformed 
is decreasing in importance, as the percentage of GNP generated 
by service industries increases; even today, more GNP is derived 
■ from service industries than from manufacturing. Furthermore, 
wit^ an anticipated reduction in workihg hours* and increase in 
traffic congestion, there will be a growing wish by many to work 
at or near hom^ jln lieu of going to the 'offdce^."* 

Whether commuhication takes place from the hdine or a field office ,re- 
jnote from the central' work location, computer-assisted meetings may play as 
important a role in future planning and decision-iaak^ng "patterns as tele- 
phone conversations have until today. Murray Turoff , addressing the parti- 
cipantsy At^ the* International Computer Communic actions Conference in 1972, 
pointed out: 

-.the seemingly straightforward conqrfpt of automating the con- 
, ^ *f ere^ice cai^ ohNa^modern time-shared co'r^uter system offers a 



/^Paul B^ran, Potential Market Demand fpr Two-^ax^ 'Information Services 
to the Home', IBIO-IOBO*, Report. R-26, -Institute, for the^Future (December 
1971) , p. 14. I 



unique ability to allow effective communication v/ithin larger 
• groups than would normally be possible in a telephone conference 
ckll."* ^ ^ 

Reviewing these concepts, J..C.R. Licklider defined the role the compu- 
^ te d play, in such interaction. According to him, the comptiter: 

4 

"...could introduce a dimension not ordinarily available in face- 
to-rface conferences. It could provide on-line informat/ion re trie- 
^ val and processing tot example, retrieval and reductipn^Gf data 
from on-line data bases, and dynamic display of model^ reflrieveci 
from files of models maintained within the network."]^* 

. Taking as an example the case pf a scientist who participates in a se- 

' ries of meetings concerned with planetary science, Licklider commented upon 
the value of teleconferencing (which he defined «as "interaction among geo- 
graphically separated people ai^ though they'were together at a conference") 
this scientist typically: 

•J 

"...does not like to travel; he is interested in cutting down the 
number of meetings that he has to attend in Washington. Perhaps 
more fundamentally, he is concerned that the thinking and planning^ • 
that goes on between meetings is less effective thcin it should be. 
Should it not be possible for subsets of the committee, groups of 
^ two or three scientists interested .in a particular '^acet of the ' \ 
overall problem, to interact tlirough telecommunication channels? 
Should it not be possible for them, in such interaction, to take 
advantage of compiuter-proces sable data -bases, computer-program 
models, and^acka^es if computer programs designed to facilitate 
the kinds ht calculations involved in the planning of .space 
exploration^"*** 

Accprding to Turoff : 

"Economics already favors computerized conferencing, even, for 
fairly small groups^ within organizations xhat have compujLkrs and 
terminals. As mini-system and terminal costs decline and digital 



♦Murray Turoff, "PARTY-LINE and DISCUSSION Computerized Conference Sys- 
tems", in St anley Winkler, ed. , Compatex Commnications : Impacts*^ and impli- 
cations, Proceedings .of the First International Ccinference^ on Computer Cjom- 
municatiun, Washingtqn, D.C. (October 1972)^ p. I6l. 

**Brown, MilJ^r, and Keenon, eds.^ Report of the Summer Study on Infor- 
mation Networks -(New York: John Wiley & Sons, 1973) , p. .155. 

Ik 

***Ibid., p. 156. . ^ 
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^ata netv«.rks come into wide use, we should by the late seventies 
find this camnunication n^de to be guite commonplace."* 

^ The loss Of time and the expense involved in traveling are not the only 
inefficiencies in face-to-face meetings. They can lead to decisions made 
under pressure, and there is rarely an accurate ;ecord of the conversations. 
Also, many potential contributors are excluded from these meetings by time 
and distance constraints. Decisions made in fac,-to-face situations often 
leave participants with thi feeling that a greater degree of creativity and 
Plain Wisdom would have been possible in an environment which facilitated 
full cqnununication and the sharing of documented facts. 

Applications of computer conferencing are not- limited to " sc ience^De- ' 
cision-makers in all fields often report that they spend too large a "part of " 
their time traveling to meetings and conferences. The energy shortage of ^ 
1973/74 has dramatized this fact and has led many to x^consider the need for 
such extensive travel activities and to search for communication alterna- 
tives. In the February 1974 issue of Teleccrrmanications , Paul Polishuk ad- 
dressed the question of the possible savings in the substitution of telecom- 
munications for transportation. It would enable, he wrote, 

• th;'indi^d'^r ^° Pl^"' and socialize closer to, 

in! residences of the employees. Particularly appeal- \ 

ing other than as an energy conservation mechanism, is a better ) 
quality of life for^Ji^^ individual citizen'. Bonus effects wou!^ 

grachic" ^^^^^"^'^ - metr^^ura^'geo- . 

Of S^rn^?^^ congestion on main arterials intrand^u? 

consumed''^ .:" ^« decreased, and less time would be 

consumed in journeys to and from work." 

In^early December 1973,. when the Netherlands was without gasoline, the news- 
papers reported that use of the telephone increased by ten to twenty percent, 
confirmation of such an effect by accurate statistics would point -to the ex- 
istence Of a serious, opportunity for more widespread use of electronic com- 
^nications. In the military, field, the availability of trax^portable , geo- 
graphically distributed management systems, is an obvious requirement. Here 
again,, teleconferencing could njake a significant contribution to their 
design. 
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Although our society claims to make good use of advanced technology, 
most decision-making is still taking place through mechanical action rather 
than through eiectronic-equiE«ient support of intellectual effort. Very lit- 
-tle technology has been made available until now to unburden the manaqpx: 
"faced with cumbersome communication problems. Most businessmen travel every 
day.lx^ car, airplane, and train to go to work. Qnce in the office, they 
again resort to mechanical means to make their thoughts manifest: they fill 
out forms, write letters that have to be typed by physically hitting pieces 
of .paper with miniature hammers, and they move physical blocks of files and 
reports through the organization to accmpUsh visible results. 

The efficiency of this type of work decreases with distance between 
workers much more r.apidly than an inverse - square function. Contact -wi^th 
'people in the next eff ice involves a finite commitment and effort. Con- 
tact Kith personnel in another wing of the building complex is certainly 
not casual. And dealing with a part of the organization in another city 
flails for a range of cumbersome systems,' such as. the mail, the telephone; 
the telegraph, and transportation. 

It is useful at this point to recall some statistical facts of busi- 
ness activity. Thorngren and Goddard* have found that 12 to 15 percent of 
all external business contacts involved more than two participants. Few of 
these multiperson contacts take place by electronic communication. This 
needs to be contrasted with the fact that over 80 percent of all two-person 
business contacts occur by teleconmunications. • | 

In order to improve thu quality of decision-making, it is necessar|y to 
modify the nature of multiperson communication and, in particular, to_^; 
change its dependence on space to such an extent that thoughts are equally 
clear, equally well documented, and equall^^ accessible no matter what the 
locations of the author and recipient. Itfe dependence on time must hj 
changed in such a way that the pressures^^f travel schedules and the Syn- 
chronization of attendance (ar, in face-tc^-f ace and telephone conference 
calls) /are no longer important factors in decision processes. 



♦Reported in Final Report , Volume 3, Communications Studies Grpup (Sep- 
tember 1973) . " » 



' In an effort to ccxnpare computer conferencing with other modes of, com- 
munication, we have summarized the major parameter's of interaction Jltx four 
major contexts in Figure 1: f ace-to-f ace, computer network, voiCe, and 
voice plus video. The apparent advantages of computer conferencing are (1) 
the availability of an accurate record for both review and distribution, 
(2) a tie to processing services, (3) the possibility of immediate display 
of group Views , and (4), the- possibility of anonymity, which allows the ex- 
pressloh. of personal statements without group pressure. Its current draw- x 
bdck-^ ar4 (1) the lack of social contact among participan,ts, (2) the reqmre- 
ment' for .typing., (3) the loss of visual information, and (4) the sensitivity 
of the system to technical failure, 

A's^early as 1963, the Institute' for Defense Analyses sponsored research 
into early forms of teleconferencing in the context of high-level cx'ises. - 
Reviewing teleconferencing applications in use in^the United States aj: that 
time, Human Sciences Research, Inc., noted that most'^of the available experience 
was with telephone and teletypewriter conferences and with closed-circuit 
television; no ccHtiputer conferencing was employed at that time, but tele- 
type networks were no longer novelties. The authors of the report recalled 
that:*^ ' ^ 

" . . . uhe governJnent has experienced teletypewriter conferencing on 
^ jveral past occasions. In the 1948 Berlin cirisis, a large volume 
of teletypewriter conferencing occurred."* 

Use of the ordinary teletype in such interaction led to some problems, how- 
ever: 

J'The one thing most emphasized by the State Department repre- 
sentative was the need for administrative control on a teletype 
net. This need for circuit discipline on teletype is particul'arly 
due to the characteristic of the equi^^ent that if more than one 
station transmits at once the message will be mutilated."** ^ 

These remarks point to the need for an envi^onn^i^t that ^supports the confer- 
encing function in multistation discussion, provides a variety of flexible 

*Gerald Bailey, P'eter Nordlie, and Frank Sistrunk, Review of Telecom- ^ 
munications Applications in Use in the United States, Institute for Defense 
Analyses (20 September 1963), pp. 3-18. 

**Ibid. , pp* 3-18. 
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PARAMETERS OF COMMUNICATION 


UNAIDED 
FACE-TO-FACE 


NETwpRK 
CONFERENCING 


RECORDED 
CONFERENCE CALL 


RECORDED 
VOICE + VIDEO 


Max i muni Nuniber of Si tens 
i 


One- 


Number of Ports 
to the Machine 


t 

Five 


Two 


Availability of Accurate Record 


No 


\ Yes 


Possible 


Poss ibie 


Link to EOf Services ' 




No 


Yes 


No 


No 


Emotional Contents 


High 


Low 


Fai r 


Fa i r 


Signal Transfni ss ioH Capabi 1 i ty 


Large 


Fat r 


Small 


Large 


Typing Requirement 


No 


Yes 


/No 


No 


Visual Display Possible 


Yes 




No 


Yes 


Sensitive to Technical Failure 


No 


Yes 


Smal 1 


Small ^ 


Can Preserve Anonymity 


No 


Yes 


No 


No 


Allows Aggregation of Numerical Data 


No 


Yes 


No 


No 


Cost (Commercial Rates) 


I2< pe- MTIe 
$100 per Day 


''$15-60 per Hour 
per Part icipant 


Phone pharges 


$230 per Hour'^ 



*6ased on the rate charged by the British Post Office for its Confravlsion service. Conference 
Picturephone service betweep» Chicago and New York is $6.50 per minute; and service between Washington, DC 
and New York is $2.50 per minute.: 



Parameters in Four Communication M§dia 

VJ 



Figure !. 
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activity structures, and decreases the reliance on simultaneous, interactive 
exchanges v^iere all participants mus't physically be present at terminal sta- 
tions at the same time. 

Modern^ computer networks h,ave the required properties for such. an envi- 
ronment. Conceived by its developers as an experiment ia resource sharing, * 
the ARPA network, in fact, provides a communication capability as a by- 
product of its data processing power. The program described here draws from 
both of these capabilities. * 
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II/ THE FORUM SYSTEM 



A, BACKGRCXJND AND RESOURCES ^ 

The Institute for the Future began its investigation of teleconferenc- 
ing through its interest in the improvement of methods by which experts from 
diverse fields address problems in social forecasting and technology assess- 
ment. In March 1971, the Institute proposed to the Advanced Research Proj- 
ects Agency^: 

t 

"..•to explore the applicability of on-line group conferencing fo^r 
TDolicy formulation via computer, terminals. The key goal of such' 
^ conferencing will be the effective use of judgmental data as input 
for forecasting,' planning, and decision -making , where the partici- 
pants are geographically separated." 

In organizing this research, we were able to draw from the previous work 
of olaf Helmer and Paul Baran, at the Institute for the Future, and from the 
efforts of Murray Turoff, at the Office of Emergency Preparedness; Thomas 
Sheridan, in citizen participation research at Massachusetts Institute of 
Technology; Norman Dalkey, with computerized Delphi at the Rand Corporation; 
and others. Our approach is unique, however,^ in at least four respects. 

1. The system is designed to support fXexible discussions that 
may be or^^anized in real time, and (^eals with computer con- 
ferencing as a telecanmuni cat ions medium. 

2. The project encompasses the development of hardware for a 
computer-controlled voice channel supplementing the typed 
interaction. 

3. The project environment permits observation of the confer- 
mces and the gathering of statistics for research purposes. 

For the first tiiue, an international computer network, ARPANET 
(see Figure 2), is used as the ' implementation environment. 

create an advanced form of teleconferencing, we have implemented and 
successfully tested a computer system called FORUM^ which is now in routine 
operation on the computer network of the Advanced Research Projects Agency. - 
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Figure 2. ARPA Network, Logical Map, January 1974 
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Thfe basic idea of FORUM is to allow unhampered interaction of partici- 
pants under the guidance of an organizer who defines a topic of discussion, , 
assembles a panel of participants on that topic, and presents the'material 
relevant to the subject. Each participant establishes communication with 
the computer network via a portable teminal with a standard typewriter key- 
board. FORUM is able to convey questions and answers, assemble group opin-„ 
ions, protect anonymous statements, and supply other information to, and 
within, the group while the organizer monitors the proceedings' .and inter- 
venes as necessary. 

In order to illustrate the nature of the interaction made possible by 
FORUM, it is appropriate to imagine a hypothetical discussion* among a group 
of experts on the subject of , the projected availability of mineral and energy 
resources in the period 1980-1990. The participants are about twenty in num- 
ber. Among them are planners, economists, geologists, and petroleum experts. 
Tyo are specialists in computerized data bases- In addition, there might be 
representatives frojnii power and utility companies and the president of a min- 
ing corporation. The organizer of the conference has experience' in dealing 
with groups and is familiar with the various techniques which can be brought 
to bear on the elicitation of forecasts and intuitive judgments in areas of 
high technology. * 

This hypothetical conference differs from the usual workshop in that 
the participants are not meeting face-to-face. Instead, they are geographi- 
cally separated and use a variety of communication media. Some are sitting 
around a terminal in a Washington, D.C., office building. A geologist is 
in the conputer room of the Branch of Computations of the U.S. Geological 
Survey in Denver. One of the econanists is in his office at Stanford Uni- 
versity. Another one may be sitting in his study at hone in New Jersey or 
in London, for that matter. (These experts are in telephone communication 
with a central operator who can instantly advise them of the status of the 
conference, of the progress of work done in subcommittees, or of the rea- 
sons for any particular difficulty or delay.) -The substantive part of the 
interaction takes place through entries typed on standard terminals.' All 
of the terminals are connected to the network and are controlled by a computer. 

*Actual examples drawn from real-life conferences are given m Sec- 
tion III and in other parts of this report. " 

24- 
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Figure 3* Work Station Used in Computer Conferencing 
(Showing the Use of a Parallel Voice Channel) 



ERLC 



Z5 



-15- 



This is the capability of FORUM. 

Before describing our research approach, instrumentation, and, findings 
in detail, it is useful to describe the environment in vdiich the work has 
^taken place. The Institute for tiie Future i's a sriall, nonprofit organiza- 
tiorv formed in 19681 It. has special expertise in the development of sh<3rt- 
to medium-term forecasting techniques. It receives support from priva^te 
foundations, private corporations, and government agencies for the develop- 
ment of descriptions of future' environments and for the improvement pf tech- 
niques through which 'to arrive at such forecasts. In both types of assign- 
ments, the extraction of the collective thought of groups of experts is a 
critical task. 

The Institute does not have its own computer. All of the work on 
ARPANET is performed via remote terminals, most of them of the portable va- ^ 
riety illustrated in Figure 3. These terminals are linked to the network 
by ordinary telephone lines concentrated by a small, remote computer known 
as a TIP, or TermiijaJ- Interface Processor. Once the connection to the TIP 
has been obtained (by dialing a local telephone number) , we proceed by re- 
questing access to one of the network's "host" computers where the FORUM 
program is stored. At the same time, other ARPANET users may be entering 
the network at other node points, such as Washington, D.C.; London; or Oslo; 
through local phone calls. The specific ccsnputers we have used on the net- 
work are those of 'the Information Sciences Institute (ISI) at the University 
of Southern Cali^fornia in Los Angeles and the Bolt, Beranek*and Newman Com- 
pany (BBN) in Massachusetts. They are of the Digital Equipment Corporation 
PDP-10 type and ,use the TENEX time-sharing executive. 

The facilities available at the Institute (see Figure 4) consist of two 
blocks of threes rooms, separated by a distance df about 200 fee^ and consti- 
tuting a miniature laboratory for office automation. In these offices, we 
'have installed a variety of terminals. Over the first year of^4:he project, 
mainly devoted to progranaming, four terminals were used.' This number was 
expanded to eleven over the second year to permit experimentation with alter- 
native wrk styles where staff members could, for example, have terminals in 
their homes. Terminals were occasionally loaned to outside parties involved 
in field tests conducted by our group. One terminal is a Terminet printer. 
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and another is a cathode ray tube display^'opera^Xng aL a high transmission 
rate (1200 baud input) . This rate is made possil^ie by the hardware inter- 
face at the nearest acce^ node, the NASA/Ames TIP entry tpoint to the net- 
work. 'One'work station is used by the conference controller and contains 
a te'rminal with, tape ^cassettes that permits the storing of conference text 
in tape archive form. 



RESEAICH APPROACH 
The central problem of implementing a computer conferencing system 
clearly reduces to that of identifying, defining, and implementing- a range 
of structures under 'which the participants are able *to share information 
and enter comments -into a conunon cotnputer-storage .file . 

• The* implementation of a system like FORUM raises unusual problems of 
design: ;»a group of experts or decision-Quakers typically does not have much 

'.knowledge of, or interest in, computer tecfhnology per se. There is no op- 
portunity to train then in the use of a text-oriented language before the 
conference. And it is not feasible to ask them to interface with their 
peers through information specialists because each participant has a unique 
awareness of *the problem At hand and needs to experience direct contact with 

Jiis, data and with other participants in order to perform at the "cutting 
edge" of his thinking/ 

When^a group of conferees communicates via FORUM, each participant uses 
a termih^ of the type that can be rented for $150 a month or less. Once 
the terminal h^s been logged into t]:>e network, the user is presented with a 
list of 'discussions which he can attend (just as he wouldVif he were to walk 
intQ the lobby of a conventiori center to' review the day * s 'program) . Having 
selected an activity, the conferee is given a short background statement de- 
scribing the activity. He is then free to observe the ongoing discussion, 
to review past comments entered into the conference , 'or to start typing his 
own remarks (see^Figure 3)/ Af any point during the discussion, a conferee 
can send a private message to. anothr^ participant or make an anonymous entry 
All of these communication modes (which Appendix 1 of this report attempts 
to characterijSe in a more formal manner) can be entered without the partici- 
pant having to learn a single ' caumand, thtis avoiding a major problem of most 
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interactive systems in existence; naitiely, that system commands get in the 

way of the person who types and clutter the transcript with- extraneous lines 
I * ^ 

that only have meaning for the machine. 

An important facet of FORUM conf eretices lies in" the ease with which the 
participants have access to services outside of the discussion itself: they 
can, for instance, submit a prepared statement to the rest of the group or 
insert parts of the discussion into a personal file. They can also draw re- 
sponses from a data-base system and enter them into the general discussion. * 
Clearly/ the level of interaction thus reached is one not found in face-to- 
face meetings where experts are cut off from their files and personal notes. 

The initial tasks in the FORUM project included an analysis of the 
available resources and a review of the existing terminal technology in 
terms of character set, plotting symbols, size of frame, speed of presenta- 
tion, and interface standards. A decision involving the programming lan- 
guage to be Used had to be made early; after exploration of the languages 
available on the PDP-10 unfcr the TPNEX operating system, we reluctantly 
concluded that assembly language was the only suitable medium to gain ac- 
cess to shared files and to control terminal behavior, both functions being 
critical to our goal. Additional requirements were speed and low central- 
processor utilization. 

Actual development of the FORUM program proceeded through a series of 
stages identified as "releases" . The version curr<=^ntly running on ARPANET 
is release 5, Most of the user experience reviewed in Chapter III of this 
report was based on this release. A description of the various release fea- 
tures is useful for the record. 

Release 1 was the first package that formed a working system. It in- 
cluded the capability to simulate simple questionnaires and supported asyn- 
chronous interaction only, without feedback of results. 

Release 2 permitted multiple rounds of a questionnaire. Disjplay com- 
mands were expanded, and a structure for agenda items was created^. A link 
connec'tion wiuh the conference chairman (or organizer) was made possible. 

Release 3 became available in December 1972. It included a simple com- 
mand language for the conference participant; a detection for loss of car- 
rier, thus permitting the user to terminate a session by simply hanging up 
the telephone (rather than taking the time to log out) ; and a mechanism for 
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adaptive instructions based on skill ratings* A primitive syn^^onous- 
conversation program was introduced and was used in re^^-life tests. Tree 
structures and file implementation were achieved in this release. 

Release 4 marked a departure from the initial approach that had cen- 
tered on the implementation of the basic questionnaire-type system. 
Discussion-oriented features (such as automatic message identification by 
authof name, private-message mode, anonymous-nnessage mode, and a host of 
min r adaptations) opened the way for the utilization of the program for « 
general conferencing. We began exploring alternative display modes for syn- 
qhronous discussions. The use of the program by ARPANET participants be- 
came significant. 

Release 5 (\a use on ARPANET since October 1973) was the first version 
that could conveniently support heavy usage by real-world participants* The 
code had been modified to make the entire program sharable. Performance mea 
surexaents showed its central-processor utilization ratio to be excellent 
(one minute of CPU time for two hours'^f synchronous discussion, per partici 
pant) • Most commcoid -language features became available to the user within 
the discussion itself, and use of control characters was practically elimi- 
nated. The ability to retrieve and display past entries by date, name, con- 
tent, and range was made available. At that point experience with FORUM al- 
ready included serious" utilization by ARPA management and approximately four 
inonths of field testing by the Autanatic Programming Group at USC-ISI. 
Network-wide discussions were conducted routinely and included such topics 
as the design of advanced teleconferencing systems, the transportation/ com- 
munication trade-offs, and initial exchcinges of research information with 
the CoTununications Study Group in London. 

Higher-level versions of FORUM are being designed. They feature a sin- 
gle, integrated command language, a generalization of the concept of a con- 
ference to make joint authorship and other management tasks possible, and 
a scheme for handling private messages in a personal user file rather than 
as part of the main discussion. 
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C> THE NETWORK ENVIRONM ENT 

In attempting to relate FORUM to other types of computer coimiunica- 
tion/ it is helpful to draw up a map of information-exchange modes avail- 
able through FORUM (Figure 5) . A certain mode of communication corresponds 
to each element in the matrix t Mail is the mode in which one sends a mes- 
<5age to another user with dela y, A real-time message to a group is an 
address , A file may be used as a way of sending delayed messages in one- 
self, and an example of direct coinuunication with one person to real time 

^ P^Q^^Q conversation . The functions of the FORUM system thus overlap 
in some areas with those of text editors and mail-distribution systems al- 
ready available on some ccanpui-er networks. 

The direction of communication is shown across the top, A given mes- 
sage can be sent by user A to user B immediately (column 1) , or with delay 
(column 4) , Alternatively, A and B may be in real-time^ canmunication (col- 
lamn 3) , or in delayed communication (column 6) , User A may also receive a 
real-time message from B (column 2) or a delayed message (column 5) , The 
possible recipients of A's message are displayed vertically; the Recipient 
can be a system, A himself, another individual, a group, or the public at 
Yarge. 

\ SeveraJ. limited comntiunication modes were available on the network 
prvLor to the introduction of FORUM, We have displayed them in Figure 6A 
in \the form of a single trble. 



The LINK mechanism is a crude process through which an online user caxu - 
effectively attach another ^ terminal to his own and send One-line messages 
acros^ the network. Every character typed is seen by the other person. 
There \.s no opportunity for correcting errors and no more than four users 
can be interconnected. The LINK is useful for such operations as brief mes- 
sages to\the operator. 

The ^ND (send message) system is intended fk^ use by prograimmers and 
specially \^rained personnel in exchanging brief (usually less than ten-Line) 
statements ^uch as announcements, plans for meetings, etc. The availability 
of this syst^n has made- an impact on management patterns on the network by 
unburdening executives whose schedules made it difficult to respond to tele- 
phone calls or\regular mail, SND is machine-independent in the sense that 
a message can bfe sent to a user at any computer on tlie network where the re- 
^ cipient has an ac^count, 
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A third means for the canmunication of information among users of the 
same. ..chine is the NLS journal. This is a mechanism that accepts as input 
a structured file produced by, NLS. NLS is a sophisticated text editor based 
on the (aathematical concept of pie., v*ich is a generalization of a tree 
structure. The file is treated as an •■article" that is disseminated by the 
system to a list of addressees and is retrievable by them.^hrough the text- 
editor. 



Both SND and the NLS journal' are totally asynchronous (delayed) . The 
LINK process is exclusively real-time (simultaneous) . 

one caQ see in Figure 6B how some of -the functions of FORUM overlap 
wxth the processes described above, superseding seme of them and probably 
enhancing the usefulness of others. Also obvious in Figure 68 are the 
Clearly delineated interfaces between FORUM and. four categories of, func- 
tions it does not support: (1) computing capabilities;/ (2) text editing; 
(3) information retrieval; and (4) publication systems. 

These four tj^pes of capabilities are available on the networJc in one 
way or another, and we have only begun to tacJcle the problem of integrating 
them With the conferencing functions. We have, however., taken care to pro- 
vide FORUM users with transparent interfaces through which they can have ac- 
cess to such systems. They can, for instance, create a "lower forJc" of the 
operating system (giving them access to all the features of the machine) 
without leaving the discussion activity; they can also save entries from a 
conference in a personal file,for later processing, or submit' such a file 
as a prepared statement into a conference. These features have been avail- 
able in FORUM since release 5. 

- The interface with text editors is provided in the design for release 6. 
•The. user can modify his entry by simply hitting- an ESCAPE key on his" Semi- 
nal and calling a familiar text editor by name, for instance TECO. And fi-' 
nally, we have provided an interface with a voice-conmunication system that 
will be described below. 



D. VOICE CHANNEL 

If a computer-based system is to be truly useful for dedlsi on-making 
purposes, it is necessary to tailor the system to fit the user needs and 
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Figure ?. Renwte Access to a Computer Conference 

Ann McCown, Richard Miller, and Hubert Lipinski are shown here 
participating in a conference running on a remote computer. 
A speakerphone is used to maintain a parallel vo.ce connection 
with other participants. 
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not require the user to fit the' oonstr.ihts of the terminal. Jsers are of- 
ter unaccustomed to using computer terminals or even to typing. To' provide 
comfortable and effective interactive .response for people accustomed to sec-' 
retarral support for converting their thoughts into clear language te.t. ac- 
cess to communications media in addition to the computer terminal appears 
necessary. To expect all- participants in i„g„i^ ^ „,^^^„ 
constraints of a single computer-terminal system may be unrealistic unless 
it rs possibl. to achieve a markedly higher, more refined degree«f compu- 
ter/human interaction than that observed to date. Although improved ^rson/ 
e»i„al interaction is a goal of *e present syst^ development, the Insti- 
tute has not achieved any major increase in the ease of interaction for an 

unsAilled user using the computer terminal h«„^ 

^ terminal. Hence, it appears reasonable 

to conclude that other media-and especially two-way voice communication- • 
wrlrbe more than a useful adjunct; they will be a necessity. „e e-pect 
initial use of the voice channel to be for the online training of new users 
o;^»M and for recovery instructions. In addition, we contemplate using 
it in interviews of the participants during some fo^al experiments. 

The present state of the art of voice-conferencing, equipment is not . 
highly developed. Telephone conference calls may be placed commercially 
■ workable with as man^. as five persons) on a manual basis. Here, as in all 
present types of conferencing syste,.s, all sp.4kers may-^talk simultaneously 
and thus any speaker may interrupt any other. 

A more useful system would allow "order wire control" and permit tighter 
control and discipline, thus incfeasl,^ the number of users who may ' simultan- 
eously talk to one another. A search of existing equipment found none that 
-uld fit the needs of this project. Hence, it was necessary to draw up spe- 
cifications for a new type of system. 

The basic problem faced in specifying a voice-conferencing equipment 
-sign IS -that there is no single best arrangement. While we do not know 
the ideal parameter choices for the design, we do appreciate the fact that 
changes in the , conununications media fcan have profound effects on the nature 
of the comnunications that transpire. 

The precise manner in which the voice system will eventually be used 
- practice dictates the choice to be made. Vet eventual use cannot be 
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specified a priori at this early stage o€ developme^it . ' Hardware constraints 
must first be determined and the human behavior response operating within 
such constraints must be tested. Accordingly, we sought to specify a some- 
what "universal" voice system in which a wide varipty of alternative voice- 
communication configurations could be tested. Zero cost and infinite capa- 
-bility rarely go together: the more general and nonrfstricTting the system 
specification, the more complex and expensive the resUting system design. 
As a compromi-se, the Institute considered a set. of five representative 
.benchmark designs, or models, in detail. The resulting parameter sets were 
presented as points from which one could estimate final design specifica- 
tions, knowing what each specified feature implies in hardware and develop- 
ment costs. On the basis of these five models, one configuration (among 
many possible hardware co/if igurations) was selected and built. (See the 
special institute report Wpaul Baran, l^oice-Conferencing Arrangement for 
an On-Line Interroation System, March 1973.) 

The prototype system which the Institute has tested is designed to 
place lines in one of two states: 

1, monitor only; or 

2. talk only (can be used for general broadcast, in which case 
a line may be connected to all conference paths) . 

A link -is supplied to the systm for external connections to a general- 
purpose computer. The design of the system allows the general -purpose ma- 
chine to control th.e- system. The s^ritching technology is analog; upgrading 
of the. switch to handle digital traffic, if necessary, is possible. The 
initial design does not support Touch-Tone from the telephones for system 
control. 

The system was built by Mr. 'Dean Romein, under the supervision of Dr. 
David Farber of the University of California at l^i^e, and is depicted in 
Figure 8. 

\ 
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Figure 8. Voice-Conferencing Hardware (Prototype 1) 
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III. EXPERIENCE WITH COMPUTER CONFERENCING 

Since versions of the FORUM program were made available to ARPA manage- 
ment in August 1973 and to t>ther network users in October 1973, actual ex- 
perience with the system can be reviewed and analyzed. It is important to 
emphasize that in the present report we are not addressing the questions of 
psychological and social effects of telecpnf e^rencing, which our group is 
studying separately and will report in Volume .2, We are specifically re- 
porting our findings from three major sources user information: the 

\ 

data supplied to us by the Information Sci'ences Institute at the University 
of southern California, where FORUM has hac? considerable application; the 
various collaborative experiments we have been able to observe; and inhouse 
experience at the Institute for the Future • 

# 

A. CONFERENCING AND DATA-BASE SYSTEMS 

■ ■ — ■ h 

As an illustration of actual use of FORUM, we might consider a confer- 
ence rur in May 1973 which linked together the Washington, D.C., Denver, and 
Menlo Park centers of the U^S. Geological Survey in a series of teljbconfer- 
ences using FORUM-4. (see Figure 9.) 

The Denver participant operated a Leminal linked to an oil and gas in- 
formation systeiu resident in iNFONET's computer in Los Angeles. A geologist 
in Menlo Park was operating the DIRAC-2 interactive retrieval system running 
on the Stanford University IBM 360/67 computer. A data base of Alaska min- 
e>-al resources was maintained under DIRAC-2.* 

The following is a sample of the interaction as it developed in the en- 
vironment described (the names of the participants have been replaced by sin- 
gle letters) : 

*This system is described in a paper by Jacques Vallee and' Gerald 
Askevold, "Information Organization for Interactive Use: Design Implica- 
tions in Data-Base Systems", Journal of ASIS (July/August 1973). ^^^m^ 
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B (Geologist in Washington, D.C): 

To all participants: Please ask your requests relative to the 
^variables listed at the beginning of the session. At this time, 
Md like to ask you all to submit the first round of questions 
(i.e., retrieval criteria). ^ 

A (Geologist in Menlo Park): 

To D (Geologist in Denver): How about a list of counties? 
C (Geologist in Menlo Park): 

To B: Let's do a retrieval on pools in Colorado which have a 
production of greater than 2,000 bbl s in 1969 and produce from 
a type "A" sand. 

Cr 

To B: Retrieval criteria production i»2,000 producing rock type 
"A" sand. 

A: ^ , 

To D:" Did you get, our request for a list of counties included in 

th*e file? 

D: 

To A; Yes we have the request in the system. 
Institute for the Fpture:^ 

I wonder if you can fill this request. Can you give me the per- 
centage of unused oil and gas resources still in the ground (com- 
pared to total resources) in your sample data base. 

B: * ' * 

To Institute: We will give you the total reserves for oil and 
gas, and also the total producti.on. The difference is your 
answer, 

. " ■> 

D: ' 

To B: Here is a list of county names: Baca, Bent, Boulder, Chey- 
enne}:> Del ta, Elbert, Fremont, Garfield, Jackson, Jefferson, and 
Kiowa . 

B: 

To all: Please try and stick to the Variables listed in the be- 
ginning of the session. / 
To D: For Institute use variable LIA and LlC for reserves. 

Nine records were found which had annual production of crude in 
1969 /greater than 2,000 bSls. 
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A: ^ - ' 

O.K. D: How about a ] ist of a1 ] the oil fields in Cheyenne 
County and their annual production for 1970? 

B: 

To A: Remember that Roger has to type in the output from the 
search . ' ' . 

To all: Remember, we can tabulate nimeric variables. 

\ - 

We are now asking questions of the Al^^ka file asked by interested 
visitors. 1 

j 

C: 

To A: Can you give us an idea of what is going on? 
B: 

To A: There is one pool in the county. The pool name is Missis- 
sippian. The production for 197Q.wa5 22,180 bbls. The associated 
gas product ion vJ^s 8o6 MCF . 

A: 

We are showing Ed and Pauline how the file works. So far they 
have asked things like: How many properties contain gold and 
silver? ^ 

Chai rman : 

To A: What is the nature of the data in the Alaska file? 
M 

To D : Thanks much. 

C:: 

It is obvious to me that so far this morning we have been able to 
demonstrate a capability that the Survey has an immediate need 
for. We have also answered at least 5 letters that normally cross 
the 5th floor. 

A:, 

To C; There are no entries with W but we found- two tb^contain 
silver. ^" 

A: 

To C; We are following up on your request, #♦ 
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D: 

To ^stitute: There are two re^cords in the file with the data for 
cru^e originally in place. These two records each show 9>500,000 
fabls originally in place and the cumulative production through 1970 
was 2,293,336 bbls for one and 184,831 bbls for the other. 

A: 

To C: Both are occurrences for which we have no reserve data. 
Neither has significant economic potential. 



The participants held a conference call by telephone after the online 
sessions. The ability (found in FORUM) to link together the resources of 
several information centers / possibly operating different computer networks , 
was seen by all participants as a concept of great interest. 

B. FORUM IN RESEARCH 

It is often tne case that members of a scientific research team work 
away from one another and rely on a communication medium to remain informed. 
Even when no geographical separation is involved / however / a tool such as 
teleconferencing can provide a convenient way for scientists to pool their 
ideas and support the research process. 

Beginning in July 1973, FORUM-4 and eventually FORUM-5 was used as one 
medium of ccxnmunication for the Automatic Programming Group at the Informa- 
tion Sciences Institute (ISI) of the University of Southern California. The 
research being done during this period involved advcinced work in the area 
of automatic computer programming. The style of FORUlM usage which developed 
provided a kind of collective note pad for the research team. In this ap- 
plication, then/ the role of FORUM was quite specific and somewhat limited. 
A^ the end of a two-morith period, two Institute researchers visited ISI to 
interview all the participants and obtain their reactions to the medium. 
The following is a summary of the findings. 

There were nine active participants in the research group using FORlilA, 
and they were divided into small topic-oriented groups. Each of these small 



groups had individual concentrations, but there was' also a strong need to 
keep in touch with the activities of the other small groups. 

FORUM (then still in the early testing stages) was introduced as a pos- 
sible communications aid by the project leader. A demonstration was given 
to the research staff at ISI during early June. This demonstration involved 
a synchronous conference of twelve persons, with no specific topic area to 

be discussed* 

/ 

The ^se of FORUM as a tool in the actual research began without any de- 
tailed strategy about the role it v/ould have in the group. The project 
leader simply began leaving messages in the FORUM program. Gradually, an. 
agre.ement was made for all members of the staff to check FORUM each day for 
nev/ information and add their own comments • From this point, they quickly 
developed the habit of entering summaries of their f ace-to-^f ace meetings. 

Over the period of time described here, FORUM became an important part 
of the group process* The style of usage vAiich evolved made interaction be^ 
tween groups efficient and provided transcripts as an important written rec- 
ord of the collective thoi^ght process. 

Dioring the time when FORUM was being used by the Automatic Programming 
Group, other media of communication were also being used. The media that 
can be identified as important are: 

• face-to-face meetings 'of small topic groups (usually held 
daily) and of the entire research group; 

• FORUM in an off-line iTK)de, using hard-copy transcripts of 
the information entered into the system; 

• informal meetings among staff members (e.g., those with ad- 
joining offices) ; 

• other computer-based media, suj^ as messages sent through 
network mail, copies of documents stored in files, etc.; 
and 

• FORUM in an online environment using cathod^ ray tube ter- 
minals (used niostly for skimming the text of other confer- 
ences and inputting reactions to hard-copy transcripts) . 

The FORUM discussions were u&ed primarily to store and distribute work- 
ing notes. These notes consisted of summarized thoughts, notes of meetings, 
synopses, and the additions, corrections, and comments which referred to the 
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sunmaries. The notes were not of a particularly polished nature, but w^re 
generally the "filtered" results of longer, more intense facl-to-face meet- 
ings. Occasionally, a new or rather unrefined idea was put into FORUM dis- 
cussions in an attempt to receive feedback and reactions. This feedback, 
however, was rarely entered into a FORUM discussion. 

The responses that were put into FORUM were generally triggered by hard-r 
copy transcripts of discussions which were created as special ccmiputer files 
(in TENEX) , edited, run off in multiple copies, and distributed daily. This 
organization and diAribution of hard -copy transcripts 5,was done by a '^ry 
competent editor -secretary, and was not done within FORUM. It is oii^ plan, 
however, that FORUM will gradually adopt much more of this editorial func- 

V 

tion in the future. 

In keeping these running summaries and' synopses , the records were de- 
tailed enough to: (1) allow cotmnunication between groups; (2) allow a new- 
comer to the group to read a history and catch up on the research status of 
the entire group; and (3) allow the various groups to create reports, papers, 
and more polished summaries of the work conducted during the period in which 
FORUM was used. * 

The research group at ISI was formed just before the use of FORUM was 
begun., '^ix of the nine active participants were g.raduate students, and half 
of tho^e graduate students were there for only one summer. Only basic user- 
profile data are available, though/ and there was no attempt to do .any formal 
group analyses as either pre- or post-tests. Thus, we can only relay infor- 
mation on the subjective assesanfient of the group members as they attempted 
to sort out the effects which FORUM had on their research team. 

The general reactions to computer conferencing, limited to structured 
asynchronous applications, were positive. Most parti(34.pants felt that this 
was an ^propriate limitation and that computer conferencing would, in fact, 
be most beneficial in highly structured situations. (It should be noted 
that synchronous conferencing was not attempted by the whole group, or any 
of the small groups, after the initial demonstration, in which there was 
general disappointment . ) 

There was a generally negative reaction to the necessary reliance on 
typing ^ility. This was a problem for five of the nine members of the group 
and may have affected the usage of FORUM which developed. 



The ccanments regarding specific characteristics of FORUM seemed partic- 
ularly thoughtful and sometimes imaginative. Since the participants were 
all highly skilled computer users, it is perhaps not surprising that much of 
their. attention was focused at this level* In general, the group was im- 
pressed with the simplicity and general friendliness of FORUM". However, 
this basically positive reaction w^s tempered by numerpus suggestions for 
modifications of the structure of the system* Apparently the version of 
FORUM being used at that time was alluring enough to whet their appetites 
for computer conferencing, but left them frustrated at certain points. 

The most obyious weak point, felt; unanimously , was the pressing need 
for at least basic abilities in text editing and review of conference pro- 
ceedings. Suggestions for improvement include^ adding tlie ability to inpi^t 
directly from a text editor outside of FORUM, allowing persons to rewrite 
and/or add postscripts to their own earlier conmients, allowing comments to 
be inserted into previous text, abilities to search the text according to 
various criteria, aimong others. - Most of these suggestions have now been 
incorporated into release 6. 

One of the more provocative suggestions dealt with the ability to al- 
ter existing text (specifically^ to change one's earlier comments). In its 
present form, FORUM has an implicit reverence for comments entered by an 
individual. These entries are indiscriminately frozen in the form in which 
they are- entered. Certainly this practice has a real value if one wants to 
review the chronological development of a conference. However, in other 
cases, this might place unnecessary pressures on each user. (What you say 
had better be good, because it's going to stay there 1) The ISI people sug- 
gest that som'e flexibility should be considered, and indeed FORUM now al- 
lows increased freedom in this regard. 

Most of the group members had adjoining offices and they saw each other 
daily—usually in face^to-face meetings — to discuss the research. The basic 
relationship between FORUM and these face-to-face meetings is discussed in 
the following comments: 

"The main issues in the group were not really discussed in FORUM. 
FORUM was sort pf the key that started the interaction. (It showed 
where ideas were coming together or diverging.) It kept people out 
of everybody else's hair. We were able to work independently. I 
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think we got' about three times as much work done because of this. 

But: It's so hard to know what the effect of FORUM was because we 

were interacl:ing in so many different ways at once." 
• ♦ « 

"In general, when we talked, we talked face-to-face." 

"I have this feeling that it has cut the face-to-face communication 
(at least for me). And the communication is still quite adequate." 

"Having 'this feature [FORUM] really was a nice addition to the group, 

and I think it kept them moving pretty well." 
>• ^ 

Since FORUM was rarely used as an interactive medium in this particu- 
lar case, its effects on group dynamics were necessarily indirect. Distri- 
bution of the hard-copy transcripts encouraged this noninteractive style. 
FORUM still had an effect, but it came in such areas as the following; 

"I can't think of any effects on the group which actually came from 
FORUM usage, except that we have a good transcript. It makes writ- 
ing the report much easier." 

"One of the uses for the thing [FORUM] is in the ability to catcl\ up 
with the progress of the group for newcomers." 

"FORUI'l structured things much more explicdtly." 

"You don't get tne personality conflicts in FORUM that you do in 
face-to-face meetings." , 

"I didn't see (too many individual things going into fORUM v^ich 
hadn't been tested out in face-to-face meetings. A lot of what went 
into FORUM was well filtered by individual group meetings. Occasion- 
ally somebody would put in a response, but the things which were put 
in were usually hashed out in group meetings." 

The style of PORUM usage will always affect the kind of group process 
v^iich develops. In this case, the note-pad style seemed to limit the direct 
effect of FORUM on the group process. Since little direct communication was 
done via FORUM, the effects were revealed more in the area of group perform- 
ance than group dynamics. The group generally felt that FORUM had increased 
their productivity, though they did not perceive any strong impact on group 
interaction. The one exception to this observation involved effective com- 
munication between groups, which all felt was enhanced by FORUM. 
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C> INHCXJSE APPLICATIONS 

Figure 10 shows the development of FORUM usage at the Institute for thB 
Future from August 1973 to February 1974- The purpose of this experiment 
(in which nearly a thousand entries were recorded) was to use the Institute 
itself as an initial test of the effectiveness of teleconferencing in long- 
term group coitinunication. The use of FORUM in this connection was both syn- 
chronous and asynchronous, and access was fron both home and office terminal 

A special study of an inhouse FORUM staff -meeting conference was c^i- 
ducted by Arthur Hastings, a consultant to the Institute, who analyzed the 
period fron 27 September 1973 to 4 January 1974. An inspection of the tran- 
script suggests that the conference can be divided into several categories 
relating to the project. These are^ indicated in Figure 11, along with the 
percentage of entries in each category. 

Different categories might cut* across those which are listed, a fact 
which should be remembered in any appraisal of the use of FORUM. For exam- 
ple, the categories do not fully reflect the social dimension of the ex- 
changes, such as friendly comments and personal exchanges which were often 
parts of topic discussions. Nor do they specify the actual topics of dis- 
cussion. However, examining these particular categories, we can see how 
the staff used the medium as part of its project responsibilities. 

Reports from Staff Away from the Institute for the Future 

Two staff members did extensive traveling during the period of this 
staff meeting conference. They took terminals with them on their trips and 
submitted reports on their activities £rom those locations into the FORUM 
conference. The highest proportion of entries in any category was from yuch 
reports. The value of this reporting, according tc comments from other 
staff members, wasr its immediate availability for the other staff members 
to read and to offer responses. ^ 

This use has the further advantage of enabling the participant to form- 
ulate a view of his activities arid put them into hard-copy form which is al- 
ways accessible for his own use. Further, one researcher commented that he 
and another staff member had attended the same meeting and it was only when 
each reported on the meeting via FORUM that they realized each had different 
recollections of some of the events of the meeting. 
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Figure 10. Growth Curve for Two Institute Conferences 
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Figure II. Categories of Entries in a FORUM Staff Conference 
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One qualification can be mad^ regarding this fom of reporting: At the 
time the entry is made, there may not yet be a perspective from v^ch to 
judge its usefulness, so the transcript may be filled with entries which are 
of little use to others., To avoid this, it would seem possible to hold pre- 
travel discussions among the staff to prepare for what might be reported 
and to engage in dialogue and responses to reports from traveling staff mem- 
bers as they are made in the conference. This feedback would make the re- 
ports more useful to the staff members in the office and would help the 
-traveler to know better what areas of his reports are receiving attention. 

Operations and Management of the Project 

Operations and management of the project were among the major purposes 
for \diich FORUM was used. Of course, since the members of the project staff 
were all in the same suite of offices, much of the coordination of the proj- 
ect occurred through face-to-face meetings. For example, researchers in the 
same office would naturally share information Idirectly. To use FORUM in 
such a situation would have been artificial. Also, there was no enforced 
use of FORUM during this trial period, partly because the network was 
unreliable. 

Even with these basic circumstances, the system was used for many as- 
pects of project coordination, such as setting up Ian ag^enda for a face-to- 
face staff meeting, verifying locations of terminals, and discussing plans 
for a teleconferencing workshop which was held at the Institute. It was 
used for* giving instructions, for passing information to one person or the 
group, and for stating rules, plans, and intentions in writing. When one 
or more of the staff members was traveling, FORUM was sometimes used to 
meet project-management needs. 

However ,\ primarily because of the proximity of the staff members' of- 
fices, FORUM yas generally used for the less urgent matters which required 
less ii^teraction. Frequently, FORUM* was used as a log of what had happened 
on the project, serving as a common file for the staff members. Typically, 
staff members would report a meeting with a job applicant, describe an In- 
stitute staff meeting, report on a meeting with a sponsor, discuss trial 
sessions using graphics facilitation, and other such matters. Some of these 
log reports were about activities of the project per se, like a historical 
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record, while others were reports of one person's activities vrtiich were of 
relevance to the rest of the project staff, (Some of these reports overlap 
with the "operations" category, of course.) 

It is not clear from discussion with the staff members how much these 
entries were used, but they could serve as an open file which could be re- 
viewed for any one topic, and participants reported doing this on topics of 
interest to them. The log would be particularly useful as a common-memory 
file, v^ere one participant could gain access to the activities of another 
staff member by reviewing the conference entries. Over a period of time, 
the transcript would becone an invaluable document which could be reviewed 
periodically during th^ project on a semiregular basis. 

There were three principal kinds of entries relating to the FORuM pro- 
gram itself. The first was a discussion of potential design features of 
the program, e.g., the discussion or monitor and overview capabilities. 
The second category consisted of announcements of implementation, changes, 
and features of the program. A third category had to do with problems, 
bugs, and questions. The transcript also contains comments on such topics 
as passwords, the network, terminals, and the warmth of the FORUM program 
for new users. 

Often other researchers in the field of computer conferencing would 
visit the Institute offices, and these visits were usually reported in the 
conference. Entries thus made would again serve as a memory record for "the 
group's activities and provide references to research activity relevant to 
FORUM* (These could be included under "log of activities", but they are 
enumerated separately to show the comparison between research meetings which 
occurred on trips and those which occurred at the Institute offices.) 
Thirty-six of the travel entries reported on research and researchers in 
comparison with eleven at; home. As reflected by these entries, travel was 
a rich and compelling source for these matters. 

In the "personal" category falls a variety of greetings and personal com- 
ments • There were probably many more than appeared in the transcript, be- 
cause these kinds of messages were usually sent in the private mode and thus 
are not in the conference record. They are probably essential to FORUM cj^- 
ferencing, however, because they are ways of making a written mode more 
personal. 
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Styles of Discussion 

In this transcript, individual staff members tended to be consistent in 
their style and choice of subjects, .although there may have been some adap- 
tation to the knowledge that what they were writing would be read by every- 
one (and perhaps by those not even in the conference). The most obvious mark 
of individuality was in the choice of subjects. As discussed earlier, each 
member of the project had particular responsibilities on the proj^, and 



each person's entries tended to emphasize his area of responsibility. 

Length of entries is another characteristic in which individuality is 
shown. All the staff members broke up long entries into shorter ones, usu\ 
ally according to paragraphs or topics, , This was also a function of the sub-^ 
ject itself, but the individual's preference for entry length did seem to be 
stable. 

Most of these entries were made in the asynchronous mode: they were en- 
tered into the transcript when the participant was the only person present 
(or when less than the whole group was present) and were read at a later 
time by other participants as they entered the program. Although there were 
several synchronous discussions (with two or more participants present at 
the\same time) , the staff meeting conference was primarily asynchronous and 
served wore as a discussion cind log of individual activities . 

V 

De^cision-Making 

The following decision-making issues were discussed in FORUM during 
this period : 

• monitor and overview capabilities of FORUM; 

• exchange of papers on Ccmmunications Studies Group; v 

• mailing list and bibliography; and 

• facilitator for teleconferencing workshop* 

These were relatively minor decision matters and very few in number, 
considering the range of decisions that the project faced through the time 
period of the staff meeting conference, -^For example, action decisions by 
the project staff included the hiring of a new staff person and the' design 
of release 6. Nothing regarding the former was mentioned in the transcript. 
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Entries on release 6 included announcements of face-to-face meetings to dis- 
cuss the language structure and planned features. Any discussion that went 



Conclusions on Institute Usage 

For a number of reasons we have found it convenient to use FORUM in our 
own vork. A major purpose of the Institute is to organize, structure, and 
improve the collective work of groups of experts. The probability-estimate 
elicitation and forecasting features of FORUM are being used in several proj- 
ects dealing with future trends in communicatio^is regulations, with the chem- 
ical industry, and with the telephone industry, in the study of cc^munica- 
tion trends, the panelists were called upon to make projections of a number 



of trends, and all probability estimates were processed using FORUM subrou- 
tines* Iti this application, the probability density assigned by each re- 
spondent was corrected according to his estimating ability and weighted ac- 
cording to his degree of expertise in order to arrive at a group estimate • 

Another application of the FORUM system in open-discussion mode was the 
maintenance of contact with staff members during periods of travel away from 
the Institute. One researcher, who formally joined the staff in July 1973, 
actually participated iff a number of meetings and made valuable contributions 
to the project during May and June 1973, while he was still residing in anT 
other part of the country. On another occasion,' one staff member was visit- 
ing a Massachusetts computer company and needed^ specific data. was able 
to obtain it by joining an ongoing FORUM meeting involving several research- 
ers in California and New Jersey. This led to an immediate exchange of in- 
formation that might otherwise have been., lost. 

Although many of these observations are anecdotal, one point of special 
interest in such staff-meeting situations is the fact that FORUM makes it 
possible for management decisions regarding current and future plans, sched- 
ules, and assigments to be kept for future reference In the context of tlie 
discussion in which these decisions were made. The ability to refer to such 
a transcript later is invaluable. * 



The inhouse use of FORUM also revealed the change in life style that ' 
«uch a medium makes possible. Better utilization of personnel and canputer 



into th^ choices and design occurred outside of the transcript. 
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time and the ability to extend the range of environments in which an indi- 
vidual staff member m^y work without losing contact with the team ase some 
of the advantages that point to the feasibility of applying fut^^e versions 
of FORUM in the general office environment. 

More significsmt than synchronous usage among the staff was the experi- 
ence the Institute gained in conferencing with other groups • A number of 
synchronous discussions was held with other scientists, both to introduce 
them to th^ concept of teleconferencing and to discuss , substantive research 
issues of common interest • An example of such a conference is given below • 
The participant 1*^* *lved here were Jacques Vallee and Richard Miller of the 
Institute staff ana geologist referred to as "A" who was in the office of 
smother geologist referred to as "R\ The discussion was as follows: 




MILLER '(Chrmn) : ' , . 

I thought that before we discussed the. appl ications of FORjJM, we 

might talk briefly about interpersonal communication via a tele- 
conferencing system. ^ 

'vallee : 

How do yo'j mean that, Rich? As a way of linking members of a pro- 
fessional comfTiunity? 

MULLER (Chrmn^ : 

Yes. / " 

A 

I'd like to interject a reaction by Mr. R to the prepensed agenda. 
He feels that the most important question in something like his ' 
program is the necessity to draw in many peopfe who have'no ex- 
perience with computers or ^'gadgets" — that the process has to be 
at a personal level, rather than at a mechanical level.* Therefore, 
telephone may be a necessary way to break the ice and leave new 
users with the idea of an impersonal method. 

VALLEE : ^ , , 

After the experiment we did last week (in connection with data/ 
bases) do you feel the parallel voice channel helps in solving 
this 'L.eaking of the ice" problem? 
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Let me correct my last sentence hy saying I meant NOT t(rf^'leave 
new people with an impersonal feeling until they get into it. 



I don! t think there is 
the system. 



a parallel, because I was quite used to 



R corrected me^ in that the telephone is impersonal to a degree 



A : 
Mr. 

also...it*s more ^ matter of moving from levels of ^'famil i ari ty'* 
MILLER '(Chrmn) : 

But I was not used to the GRASP system. And I thought that the 
use of voice wds a help for the first ten minutes or so, since the 
use of the GRASP system became pretty clear to me after that amount 
of time. Aft^r the first ten minutes, the voice channel was not ^ 
necessary. 



VALLEE : 

Yes, you were used to the system, but I wasn't 
that cas^. and the explanations given over the 
straightening out some retrieval problems.^ 



used to YOURS in 
phone p I D hel p in 



MILLER (Chrmn) : / ^ 

If this is the case, wh^t 
ticip^nts in face-to-face 

telepKone or teleconferencing for group discussion? 



IS the solution? A meeting of the par- 
conversation before using either the' 



VALLEE : 

...,0r a picturephone-type device that enables you to establish 
visual contact with the other person? 

A : ^ . ^ 

'-=^.Mr. R feels that initiajly visual contact vould be ideal, but af- 
ter brief exposure may be no more necessary tnan a phone conversa- 
^ 1 1 on in th,i s s«mC context. Face" tO'^f ace could be the fiiobt desi r- 
able, but may not b^ practical! 

VALLEE : . ^ 

Based on our experience so far, we feel th^t FORUM will obviously 
not replace, face-to-face conferencing, but rather will enhance its, 
ef f i!t4«ncV. . • 

V,^LLEE : ' ' ^ ' 

By this I mean that participants who have already put their main 
ideas on record via a FORUM -I ike system can skip all the prelimi- 
' naries when the time of the face-to-face meeting cbmes , and .they 



ERIC 



r 



-49- 



can get to the really substantive issues right away. In ordinary 
conferences, as we know well, it takes two or three days of dis- 
cussions to reach, that point. 

MILLER (Chrmn) : 

Also, this implies the practicality of the system for pre-formed 
work groups. For example, if the project staff has met at some 
tirfte to delineate the general problem or task, they have a feel- 
ing for the individual personality of their partners and can 
forego the telephone conversation or face-to-face meeting that 
precedes the initial session of a new work group. 

MILLER (Chrmn) : % 
This Is why I think that the FORUM system ha^ applications for • 
projects with a staff that knows each other and which communicates 
by other means besides FORUM. 

A : 

If you are wondering what the delays are due to here, we are dis- 
cussing various problems and ideas that are prompted by the "FORUM 
di scuss I on- ' 

MILLER (Chrmn) : 

We were just discussing the fact that we were probably losing the 
most interesting information that you were producing, in that the 
discussion that ypu are having is not being recorded or trans- 
mitted to^ us,. 

A : 

Mr. R is largely >fi agreement with the above points. He would fur 
ther suggest that thi^ seefns to be an argument for internal use vs 
some type 6f public or outside use. Comments? 

A f 

That is probably true. . .unfortunate! y, you will probably have to 
rely on my demonstrated faulty memory to relate some of what 
transpired. 

MILLER (Chrmn) : . 

Public use implies a lot of problems that we have ho means to eval 
uate, at least right now. The internal use also fits our descrip- 
tion and impression of FORUM as a complementary medium of communi- 
cation, rather than the sole means. 

•> 

VALLEE : 

I think the STRUCTURE of a given discission determines where it is 
placed in the spectrum^f rom private (internal) to public. 
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VALLEE : 

Of course, when a tool like FORUM Is used as a front-end to data- 
base software, the picture changes completely, 

A : 

Jacques, please expand on this last point (or elucidate), 
VALLEE : 

Fof^^ internal use you would expect to have well-defined agenda and 
applications like remote budget preparation, policy formulation, 
etc., which implies structuring (questionnaire-type or otherwise). 
On the other hand, public use implies a very loose struc.ture of 
the type we are now using, where anybody can talk at any time, and 
subjects are only determined by consensus. 

\ 

Mr. R states his prrmary concern is more with communication with a 
special segment of the public, i.e., city, county, and state plan- 
ners and decision-makers who have need of USGS data and informa- 
tion, but do not know our language or how to obtain the informa- 
tion they need. 

A : 

Structure comes through now, Jacques. Thanks. 

A 

MILLER tChrmn) : 

But if they are in dia'ogue with a member of your group, even if 
the means is FORUM, don't they have access to the terminology and 
to aid in making requests? 

«» 

A r 

In reply to your comment, Rich, he says that this follows. But he 
would add that history has shown that "expert*' professional scien- 
tists such as we have here are greatly ^r«miss in communicating with 
others. He feels the main challenge gf his project would be one of 
"compressing" large volumes of data in a "digestible" and meaning- 
ful form for the person who would have use of the data (change "re- 
miss" to "awkward" or "clumsy").... This implies large use of 
graphic and map-like displays. 

A r 

However, there is no way to avoid the use of large bodies of words 
also. I should add that Mr. R's principal interest is NOT in im- 
proving the organizational efficiency or effectiveness. .. there^ are 
a number of others who have this as a pr imary^concern. He is, as 
1 think has become apparent, more interested in the "public" that 
the project serves. 



VALLEE 

Can one do what you propose by software alone? It seems that It 
will not be enough to give people access to the dataA you have to 
give them a simple link to someone who can interpretl^ the data-'for 
them. 

A : 

Exactly so, Jacques. 
A : 

This leads Mr. R to feel that the REAL potential with something 
like FORUM would be to link the local ^'expert*' or/ would act as a 
link between the local expert and larger systems or other experts 
and the person in need of information. 

MILLER (Chrmn) : 

That sounds like an information clearinghouse for geologists. Is 
this function needed often in the time frame that FORUM provides? 
That is, how often is dialogical real-time communication of this 
type necessary in your group or by your group for the outside 
public? 

VALLEE : 

Remember that the problem calls for more than a traditional 
clearinghouse. The question from a user might involve more than 
can be answered locally. Having an on-line community of experts 
would make it possible, say, for an expert in Washington to reply 
to a question from Texas. 

% 

A : 

Rich, Mr. R states that we are looking more at an ENVIRONMENTAL 
CLEARINGHOUSE RATHER THAN A PURELY LOCAL ONE. Most of the dead- 
lines are in a time framework of months; (e.g., for planners and 
decision makers) rather than rapid turn-around. 



D> FORUM CONFERENCES ON THE ARPA NETWORK 

Figure 13 shows the growth of two user conferences that were set up on 

ARPANET in October 1973 for the purpose of exploring the software issues 

♦ 

raised by FORUM with interested and competent parties at various ARPANET 
sites. These two conferences were created on the basis of our experience 
with a wider, public exchange that had taken place in August, and September 
and had involved a very large range of reactio iS both to FORUM itself and 
to the overall context of teleconferencing. With the availability of re- 
lease 5 of FORUM in October, this public conference was discontinued and 



replaced by two specific discussions among a smaller, grbup df participants 
x^^v^o were directly involved in teleconferencing at the design level. The 
apnference shown in Figure 12 as "USERS: 1" dealt with specific reactions 

FORUM and was limited to contributors with many hours of actual experi- 
ence with the medium (most of them were frcm USC/ISI) , while the "USERS: 2 
conference centered on the associated design problems. 

During the period of October to February shown in these statistics, 
participants using the two conferences made a total of 380 entries. The^ 
rate of increase in the number of entries is again correlated with the syn 
chronous nature of scxne phases of the discussion, as reflected especially 
in the USERS: 2 conference for 9 January 1974/ when three users exchanged 
design ideas in a fast brainstorming session. 

Typical of the^ynchronous exchange is this part of the transcript, 
in which two users, who had previously been arguing in asynchronous mode 
about conference structures in FORUM, happeried to be on the system at the 
same time. (The reader will notice that, unlike preceding examples which 
were based on FORUM-4, the messages here aire numbered and have date and 
time stamps. These features were added in release 5.) / 

[71] MILLER(Chrmn) WED 9-JAN-7,^ 5:^7PM ' 
Hi Wally. What would ypu like to' talk about? 

[72] RYDER WED 9-JAN-7^ 5:^7PM 

Rich, I think 1 would like to address an earlier entry I made on 
security first. Because of the variety of different sources and 
kinds of sensitivities to information, it seems that unless a sim- 
ilar varietv of security measures is available important stimuli 
are not going to be broadcast over this medium. 

y 

[73] RYDER WED ' 9-JAN-7^ 5:51PM 

What I propose is a discussion of the variety of security measures 
that might be provided. 

[7^] MlLLER(Chrmn) WED 9-JAN-7^ 5:52PM 
RE 72 

I agree. Have you been advised as to the security measures that 
are being taken in release 67 

[75] RYDER WED 9-JAN-7^ 5:53PM 
No. Or rather only briefly. Can you help me? 
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[76] MILLER (Chrmn) WED 9-JAN-7^ ,5:5^PM- 

Yes. Let me outline what we*ve got in mind and then you can tell 
me what we've left out, 

[77] MILLER(Cjirmn) WED ^-J^H-^k 5:5^PM 

First, release 6 wi 1 1 incorporate a password system such that each 
user will have a unique password under his control and which will 
aj low access only to those persons who know the password • A pri- 
vate message file will be constructed for each user, so that they 
are retrievable and deletable under the user's control, 

[78] MlLLER(Chrmn) WED 9-JAN-7^ 5:57PM 

The new system will allow any user to set up a conference, so no- 
body from the Institute even has* to know of the existence of a con- 
ference. There will still be the problem of, getting a text file 
dumped out which will contain the text of a conference but the only 
people who wi 1 1 be able to do this wi 1 1 be people ^it;h 'NvheeP' ca- 
pability and those programmers at the Institute who know the Joca* 
tion and the password for the directory that holds the conference 
files. 

That's about it. Should I be more specific?^ 
[79] RYDER WED 9-JAN-7^ 6:0kPH 

How do you plan on handling the problem of different levels of 
clearance within a set of participants? 

[80] MILLER(Chrmn) WED ' 9-JAN-7^ 6:07PM ' 

The only "clearance" capability is the following: you can create 
a discussion within a conference ajid "deassign" that discussion 
for a participant. In other words, you can serrtl private messages 
to a group of participants in a discussion or you can lock a par- 
ticipant out of a discussion altogether. 

[81] RYDER WED 9-JAN-7^ 6i\2Ph 

I k>nder how to evaluate the cost bf not having "a1 1" parti cipants 
be able to respond to whatever stimuli they are permitted to see, 
especially in a non^real -time medium like this. It seems that 
masks might be able to buy back some of that. 

[82] MILLER (Chrmn) WED 9-JAN-7^ 6:15PM 
Hold on. Phone ca 1 1 . 

[83] MILLER (Chrmn) WED 9-JAN-7^ 6:19PM 

Wally, what type of "classified" message system would be more 
suitable? 

[84] RYDER WED 9-JAN-74 6:21PM 

Let me try to explain my simple model of the system. Unless I'm 
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> just using the conference to inform, the fundamental purpose is 

to make concepts articulate. For that purpose, and because we are 

> so ignorant of the mechanisms that make that process work, when it 
does, and to whatever degree It does,* the closer to a shot-gun ap- 

> proach you take to provide as many servers that stimuli, the bet- 
ter. Think of it as a-queueing problem. As a consequence, if the 

> different kinds of information were coded according to who cap 
read i t (the classical problem of c 1 ass i f i-cat ion , except this can 

> always be done, if desired in small packages) then as many servers 
as possible (out of the original set) could respond.' 

[85] MILLER(Chrmn) WED 9-JAN-7^ . 6:32PM 

> Are you talking about who gets the entry or how soon one gets the 
' entry wP^n you mention the queueing problem? If' it's the latter, 

> I don't w<%ow the answer otfher than sending private messages with 
the higher priority and regular messages with the standard priority. 

[86] RYD.ER WED 9-JAN-7^ 6:35PM 

> What I meant by ^fhe queueing problem in [8^] is: 

> 1. Stimuli representing concepts to be discussed are generated by 
participants. These are to be processed by other particfpants in 

» one or more of several ways (e.g.: (a) acknowledged that the rep- 
resentation adequately covers the concept and agreement (under- 

> standing) is accomplished; (b) the representation of the concept 
is inadequate, and paraphrase, refutation, or some other appropri- 

> ate response is generated; and (c) a new concept is triggered in 
•the mind of the receiver, and he begins to attempt to articulate 

> it). 

2. The receiver responds to ttie stimuli (i.e., the demand is 
serviced) • 

That's the queueing system I had in mind. 
[87] MlLLER(Chrmn) WED '9-JAN-7^ 6:^6PM 

I see, but what prevents that type -of use now in FORUM? If you 
want an automatic chairman'that operates under modified Roberts 
Rules of Order, one could structure the interchange with giving 
the floor to a participant, allowing questions and challenges, 
etc. but I have the feeling tjiat this^olution would be more cum- 
bersome fgr the task at hand. *^ 



After this Synchronous exchange, a third user came into the system, and as 
he reviewed the past entries to catch up with the ongoing discussion, the 
first participant had to leave. The conference continued as follows. 
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[102J MlLLER(Chrmn) WED 9-JAN-74 7:24PM 

If what you are saying has penetrated my thick skull, you want 
somethirig that would allow me to designate groups of parti cipants 
and then send messages to groups at my command, like (to group l) 
but not group 2, or to groups 1 and 2, b-Jt not group 3» Right? 

[103] VALLEE WED 9-JAN-7A 7:26PM 
Sounds like it requires an IDENT system. 

[104] RYDER WED . 9-JAN-7A 7:27PM 

RE: 102 right. RE: 103 ident? Help me. 

[105] VALLEE WED 9-JAN-7A/ 7:28PM 

This implies a sophisticated mechanism for identifying everybody. 
We have tried not to introduce a concept of large user file in 
FORUM. 

[106] MILLER(Chrmn) WED 9-JAN-74 7:29PM . ^ 

' I'm afraid Mm going to have to quit this for now. 

[107] VALLEE WED 9-JAN-74 7:30PM 

Wally, I haven't caught up with the previous discussion yet, but 
are you suggesting that a mechanism should exi.st for designating 
subgroups within a conference? Across conferences? 

[108] RYDER WED 9-JAN-7A 7:30PM 
RE: 106 

I understand, I'm beginning to get giddy myself. I really can't 

stand typing. Thanks Rich. Good talking to you. 

[109] RYDER WED 9-JAN-74 7:32PM 

Both, J., I'm concerned with obtaining the maximum flexibility in 
a security mechanism without having to write the number of re- 
^ spondents that can serve an entry. 

[110] VALLEE WED 9-JAN-74 7:36PM 

Is this in the context of a discussion with human users or of a 
simulation or model building? In the case of human users there is 
a danger of such a mechanism getting in the way. 

[Ill] RYDER WED 9-JAN-74 7:37PM 
RE: 110 

Human users. I don't know how much the "getting in the way" is a 
tactical design problem. Security problems themselves inhibit 
communication. What I am concerned a^out is an articulation of 
the trade-off that is inputted in any system between the complica- 
tion of the security mech. In the system, that that covers for the 
lack of one in the user's mind, and the cost of failing to have 
one because it wasn't covered anywhere. 
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[112] VALLEE WED 9-JAN-7^ 7:^^PM 

RE:: 111: How do other participants become aware of a group^s 
name, existence? Is this a chairman -(or what we now call "orga- 
nizer") function? 

[113] RYDER WED 9-JAN-7^ 7:46PM 
RE:; 112 

Sure, I don't know what would be the matter with letting the orga 
nizer be responsible for which combinations of participants had 
what security options, 

[1 14] VALLEE WED 9-JAN-74 7:47PM 
RE': 110 

I can see more need for this in modeling where group names might 
designate sets of modules under program control, 

[115h VALLEE WED 9-JAN-74 7:50PM 

Should the organizer be the only one though? Why not let every 
user designate the groups he can address his messages to? I won- 
der what a facility like that would do in a synchronous discus- 
sion. It might encourage fractioning of the main conference and 
some users would gradually get the feeling of being "left out", 
probably rightly so! In asynchronous mode, though, this would be 
a nice way to have a notification system. We have to think about 
that one, 

[116] RYDER WED 9-JAN-74 7:52PM 
RE:: 114 

That*s interesting; I hadn't considered it. Isn't it a different 
security problem? 

[117] VALLEE WED 9-JAN-74 7 :55PM 
RE: 116 

Same basic problem, I think, lender release 6 participants will 
manage their own private-message file, so the burden for protect- 
ing the file is on them, | 

I 

1 1 1 8] RYDER WED 9-JAN-74 7 :56PM 
RE: 117 

That should answer part of the problem on this system, if they 
ever handle the "group" code problem,- 

[119] MILLER(Chrmn) THU lO-JAN-74 10:39AM 
To al 1 participants: 

Does it meet with anyone's approval or disapproval to set up an 
additional activity on the subject of security and malleable pat- 
terns of interconnection, as was suggested in the conversation 
among Mssrs, Ryder, Vallee, and Miller? Please let me know soon, 
since 1*11 set it up if I don't hear any grumblings. 
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[120] VALLEE THU lO-JAN-?^ 11:00AM 

Rich, an alternative to setting up another activity might be to 
just identify this as a theme we could refer to in later discus- 
sion. Having to go into another activity is quite constraining. 

[121] MlLLER(Chrmn) THU lO-JAN-7^ lliO^AM 

I agree that it is a constraint to subdivide the discussion, but 
there seems to be a problem with mixing all the discussions into 
one giant heap. Possibly we should wait for a while to see^how 
the discussion goes. One thing that might solve all the problems 
is a means of putting in an "expanding table of contents** such 
that users would' know at a fast glance where the discussions rel- 
evant to their immediate interests are. The review by first n 
lines helps, but doesn't do the full job. 

[122] GREENFELD THU lO-JAN-?^ 11:19AM 

One can look on the confused threads of the past ^0 messages as a 
very good example of the needs and operational characteristics of 
a teleconferencing system. At some point, (I believe about mes- 
sage 110), the impatience with the medium became so great that at 
least 2 spfinter conversations got started* While it may have 
been understandable to the participants (was it?), to a later ob- 
server it is difficult. 

I should think that the need for very flexible structuring in all 
the guises of "activities" and "message-receiving" groups etc. is 
now obvious. The questions that need discussion are whether these 
structuring methods should be done at the time of message genera- 
tion (e.g., security) or at the time of reception (e.g., current 
string search) or both, or which types of structure which ways.... 
That is, this is the kind of meta-structure rule which will de- 
termine whether the structuring activities will "get in the way" 
or be enhancing o^ communication. 

[123] MANN THU lO-JAN-7^ 3:29PM 

There are applications for post hoc topical structure as well as 
on-the-fly organization of activity. For example, I may want to 
review a series of suggestions via a structure which represented 
whose money was to be spent for each suggestion, even if that as- 
pect never came up. So I may want to impose my own thread struc- 
ture afterwards. 

Reviewing by somebody else's thread structure is a useful looking 
index means. It is attractive because FORUM encourages fragmen- 
tation of a discussion rather than serial consideration of topics, 
as would be common in a face-to-face conference. The proper 
thread structure is often one object of negotiation. AN AGREED 
UPON SET OF TOPICS SHOULD NOT ALWAYS BE A PRECONDITION FOR 
PROCEEDING. 



The remark by Greenfeld (in entry #122) that two splinter discussions took 
place simultaneously after entry #110 is an observation that can be general- 
ized to most of our synchronous conferences, where participants ccMtunonly 
fall into the pattern of conducting several threads of discussion at the 
same time. Later identification and review of these threads is an intrigu- 
ing problem that will have to be fac^d in future version^ of FORUM. 

Another user conference was implemented for the purposes of allowing 
rapid dialogue and solving technical problems between the FORUM designers 
and the major users of the system. An excerpt that is typical of the dis- 
cussion is given below as an illustration of the degree of detail of these 
exchanges. 

• [37] BALZER WED 31-OCT-73 4:31PM 
RE: Message Presentation 

• On entering this conference, I was told that n messages had been 
entered since I was last here and did I want to see them. I said 

• yes, and got them in order correctly except for the last one which 
came out after the message "YOU HAVE SEEN THE 35 ENTRIES MADE SO 

• FAR(CR) IF YOU NEED HELP..." Not only that, but 'it (message 35) 
came out without a time or date stamp. 

[38] BALZER WED 31-OCT-73 4:37PM 

• RE: Use of JOIN Command 

In spite of the message about the use of JOIN (message 33), I just 

• trfed it and it was not recognized. On reflection, I assune it is 
because I have been using FORUM for many hours and my copy is the 

• old unmodified version. If I got out of FORUM and obtained a 
clean copy, I suspect (and hope) JOIN would be recognized. How- 

• ever, If I were a non-ccmputer user, I probably wouldn't under- 
stand about copies of programs and would wonder about the compe- 

• tence of the system builders whose comments about new good fea- 
tures didn't work! 

[39] BALZER WED 31 -OCT-73 4:43PM 

• RE: Previous Message 

As I suspected, all is better now that I have the current copy of 

• the program. It works as advertised. 

• [kO] LIPINSKI WED 31-OCT-73 8 : 38PM 

RE: 37 by Bob Balzer on message presentation. Message 35 by Nor-* 

• Ion Greenfeld was put at the same time you were in FORUM, i.e., as 
you were catching up on the entries you had not seen. Thus FORUM 
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did not put a date and time stamp. You caught FORUM at the trans- 
ition between synchronous and asynchronous operation. In synchron- 
ous operation! It does not put the time stamps since it doesn't 
make sense then. By the way the fact that you keep gettrifig the 
"IF YOU NEED, HELP" message is a bug. It is supposed to print only 
the first 2 times you ever use a conference. This >^ill be fixed, 
as soor> as I can since .it is starting to bother me" and Mm sure 
you also. 

[41] LIPINSKI WED 31-OCT-73 8:53PM 

Hopefully the confusion in choosing conferences will be somewhat 
reduced since FORUM now displays all conferences you may attend, 
instead of the private'and publ ig (tihat you haven't joined yet) 
distinction it made before. The ability to obtain direct com- 
ments and specific reactions from users of the' system shortened 
drastically the reaction time to suggestions for improvement of 
the 'system. It also served in increasing the acceptance of 
FORUM among our user population on the' network. 
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IV, CONCLUSION 

.A> MAJOR FINDINGS 

In the course of this project, we have learned how to use a computer 
network in support of a fundamental decision-making activity, the structur- 
^^^_^^^^g and conduct of conferences • The research issues addressed in this ac- 
tivity fall into two categories. First, from a computer science viewpoint, 
the development of file structures to support conferences raises design is- 
sues that we have identifie'd and solved in the course of our experimentation • 
Essentially, the file structures mUst allow many users to share them simul- 
taneously, and programming of terminal -oriented capabilities must be de- 
signed to make the machine as flexible as possible. Second, from a human- 
factors viewpoint,' our research has involved the identification of certain 
basic principles of communicatioi> in the computing environment and the cre- 
ation of methods for displaying/ in a meciningful way, both the contents and 
the dynamics of the comnunicatibn. 

Synch^ronous (simul^iineous) iferencing poses problems that have not 
been observed before by computer scientists. Research on conferencing under 
any cpmuuni cation medium mus^ begin with an understanding of the social 
processes within which the discussion or encounter takes place. Careful ob- 
servation of group discussion has combined with tradition to provide certain 
rules for conducting meetings. Typically reflected in the adversary process 
of a court of law, in par^liamentary debate, and in Robert 's^ules of Order, 
this tradition demands that the floor be given to each side in turn, and pro- 
vides methods for handling motions', suggestions, and the presentation of 
evidence. The availability of a computer as a tool to structure this inter- 
action opens up new capabilities. But at the same time, the classicfal text 
processing techniques do not satisfy the needs of the participants in such 
a conference, A programming effort aimed solely at providing users with an 
array of 'new commands for indexing, keywording, and defining threads in the 
course of the dialogue is clearly not the answer. 



As a teleconferencing system, FORUM has unique characteristics not typ 
ical of other computer systems. Of primary concern in its development have 
been the techniques of translating the perceived flow of a face-to-face dis 
cussion into the medium provided by the computer. The information flow in 
a synchronous conference is now well displayed by FORUM. 

Other concepts implemented in FORUM are the handling of private and 
anonymous messages and the ability to access system ;Beryices while in a 
conference. This treatment of conference activity^ v^ich facilitates so- 
cial interaction, is unique to FORUM. 

The ability of a participant to join an activity in an asynchronous 
manner has created an unforeseen demand on the system: the need to review 
past entries, add new comments or ideas^, pr suggest chcinges, for example, 
plays a more significant role than had been anticipated. As a result,' it 
has been necessary^ to expand the range of work styles available to users. 

The criteria for conducting multimedia '(computer plus voice) , confer- 
encdlng have been clarified to the point where five models of specific equip 
ment could be proposed, where selection could be applied to optimize its 
design and where actual construction of the hardware could proceed. A mea- 
sure of the effectiveness o€ the voice in actual use must await the result 
of the experimental plan we are now f emulating. 

Finally, a major requirement in making the program usable has been to 
master techniques to adapt the behavior of the systein to the demonstrated 
skill of the user. This task has two aspects: 

1. introducing an "intelligent" mechanism in FORUM to recognize 
the user's success at learning the functions of tl^e system, 
with a provision for downgrading this measure of skill when 
the functions are hot used over a certain period of time; and 

2. learning how to phrase information, as well as system prompts 
and responses, in a way that is adapted to the user's skill 

^ for a particular function and takes into account a knowledge 

that this information may or may not have been presented to 
him before. * . \ 

Based on this mechanign, FORUM makes decisions that match the user's demon- 
strated expertise, and it adjusts the degree of verbosity of its response 
to suit the needs and experience of the human participant. 
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B. FUTURE DIRECTIOSIS 

The long-range goal of the teleconferencing project at the Institute 
IS the developnent of a group communications tool based on computer-science' 
concepts. In the course of this initial two-year effort we have created a ' 
teleconferencing system that we have now been able to observe in almost 
twelve months of actual operation. It is still very primitive in several 
respects: first, the implications of synchronous (simultaneous) conferenc- 
ing remain largely unknown, both in terms of' computer support of thought ^ 
processes and in terns of user behavior; second, the possibility of multi- 
media (audio and video) adjuncts to the computer conferences has hardly 
been explored. 

Much of our work to date has consisted in inventing^ata structures 
and access mechanisms suitable for the us^g^f-xzolhputers as a communication 
medium. We have encounte^ei^twdlnajor technical obstacles in this respect, 

1. Ordinary computer architecture creates severe limitations for 
our conferencing needs. Teleconferencing will require a revi- 
sion of the organization of various computer resources in or- 
der to make efficient communication among many users possible. 

2. Ordinary concepts in file processing, that rely on separation 
of user files and access paths, do not apply in the conferenc- 
ing environment. We have found that a sifigle uger, namely 
FORUM itself, had to*have complete access control. This leads 
to an unusual situation in terms of privacy, protection, and 
accounting. 

An extremely rich domain for further research has been identified in 
the course of this effort. The specific computer-science questions it ad- 
dresses (leaving aside the entire field of social impact and psychological 
reaction to the medium, which is discussed in Volume 2) follow. 

• How can conferencing be interfaced with other functions shown 
in Figure 6A, especially in the area of text editing and fact 
retrieval? 

• How can a mechanism be provided for the identification of se- 
mantic threads and subgoals in a discussion? 

• How can the knowledge of man/machine interaction be adapted, 
or extended, to a nonclassical situation of computer-mediated 
group communication (man/machine/man interaction)? 
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• How can a conferencing program be offered at a very high lev- 
el of reliability over a network where actual processing of 
the conference activity becomes machine-independent? 

When computer communication becomes more widespread, we foresee a num- 
ber of new problem areas that deserve careful exploration. One of these 
areas involves the coupling^f conferencing activities to other functions, 
such as document prepciration and publication, that cire equally vital to the 
management task. Another is the definition of retrieval functions capable 
of operating on what is basically an unstructured, unindexed data base. 
Yet»another area deals with the adaptation of the computer to the needs of 
an office environment. 

In considering the last point, it is useful to remember that manage- 
ment information systems have largely failed because their assimilation in 
the framework of an executive's activitiei3 present too, high a threshold in 
terms of training, usage patterns, and restriction of information types. 
Reliability and privacy are at the top of the list of the requirements for 
a successful systen\, and these must be addressed immediately. It is un- 
likely, however, that certain constraints — for instance, the need to type 
on a keyboard — ^will be removed within the next ter\ years.. Human factors 
aspects of software design have been generally neglected; under these con- 
ditions we feel that considerable attention should be devoted to psycholog- 
ical and social factors before any attempt is made to introduce teleconfer- 
encing into a large, operating environment. 

Another aspect of teleconferencing that requires further examination 
on the basis of the trends we have already observed concerns the trade-off 
between travel and communication. Writing in the February 1974 issue of 
Telecommunications f Paul Polishuk has stated that; 

"The Office of Telecommunications believes, based on analyses con- 
ducted to date, that as much as 5 percent of the total annual pe- 
troleiim consumption in the United States can be saved by substi- 
* tuting telecommunications for the transport of people and goods." 

While our own project intends to explore these substitution possibili- 
ties further, experience with the FORUM medium leads us to consider as 
equally exciting the opportunity to regard computer conferencing as a genu- 
inely new way for groups to exchange ideas, to do planning, and to arrive 



at decisions. Especially relevant in this respect are the observations by 
Arthur Hastings that ''FORUM conferencing at the Institute clearly resulted 
in staff members having a common ground for ccatimunicating" and that "the 
highest projx^rtion of entries in any category (in the staff meeting) is from 
reports made while traveling," If a communication framework can be main- 
tained, and even enhanced, while members of a research group or management 
team are physically separated by large distances (as in the situations we 
have observed) , ^then a major change in work styles and intellectual pat- 
terns seems to be possible. Such a change may be even more significant in 
the long run than the energy savings which teleconferencing may provide-in 
/he near €3l:ure. 
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APPENDIX 1: FORUM USER GUIDE 



A. JOINING A FORUM ACTIVITY 

The ARPANET environment demands that a user connect his terminal to a host 
computer through the following actions • 

1, Dial the TIP number; wait for high-pitched tone; and place phone in ac- 
coustic coupler. Both terminal and coupler should be set for FULL and 
30 cps. , ( \ 

2. Type everything printed below in boxes ^ leaving spacei^4i^re they are 
shown and ending each line with one carriage return [CR] • 

Hello. • 
gD C ElCRi 



@L XX[CR]f where "XX" is the number of the host computer 

I SI-TENEX... 

e ^iOG [DIRECTORY NAME] [PASSWORD] [ACCOUNT] [CR][ 
JOB 

@ tcDIRNAME>FORUM [CrU where "DIRNAME" is the specific directory 

This yiill staurt the FORUM program. You will be asked for your last name 
and information concerning teminal equipment you are using. 

/ 

You will then get a list of the conferences available to you. If you choose 
none of these, the FORUM program will autcxnatically return you to the TENEX 
executive. {Note that if you are using the CHAIRMAN program, you may opt 
not to join an exis'ting conference, and will be given a "COMMAND?" prompt 
and the ability to set up a new conference.) If you are registered in only 
one conference, FORUM will start you in that conference automatically. 

Having selected a conference, its title and information on its structure 
and participants will be printed. Since most of the activities in a con- 
ference are discussions, the following sections concern themselves with 
this type of activity. Other activities (e.g., eliciting a number or a 
probability estimate) are explained by FORUM and require no background other 
than that obtained by typing a question mark (?] . 

/ 

Making an Entry in a Discussion ^ 

While in a discussion you may make an entry at any time — simply start typ- 
ing. To end an entry, strike the carriage return key [CR] twice. See in- 
structions for editing entries on pages 74 and 75. 
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Welcome to FORUM. 

Please register by typing^your last name and then striking the carriage 
return (CR) key. 



Good. Are you using a terminal that prints on paper? Please type Y for 
YES or N for NQ and then itrike the carriage return (CR) key. 

- Y 

Thank you. _ 

You may attend any one of th^ foMowing conferences: 

1 System Design Conference 

2 Staff Conference • 

3 Department Directors Meeting 

Please type the number of the conference you wish to Jo>n and then strike 
the carriage return (CR) key. 

I 3 

The title of the conference is. 
Department Directors Meeting 

Background information: 

This conference wi M include discussion activities and other information 
ellcitatlon activities for the meeting of department directors. > 




f 

Figure I3. Entering a FORUM Conference 
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Making an Anonymous Entry in a Discussion 

Begin your message by striking the exclamation point [1]. (Note that 
must be the first character typed.) Type your message as you would for a 
standard entry, ending it with two carriage returns [CR] . 

Sending a Private Message 

Begin your message by typing a left parenthesis [(] as the first char,acter 
typed. FORUM will autcanatical ly print the word "to". You should then en- 
ter the name of the recipient of your message, followed by one carriage re- 
turn [CR] . FORUM will prompt you for your message with a hyphen [-] . You 
may then begin typing the message. End your message with two carriage re- 
turns [CR] - For example: 



Two means of accessing FORUM ccxnmands are available in release 5. 

1. WhjLie participating in a discussion activity, you may send a private 
message to FORUM rather than a human participant. This allows you to 
access special FORUM services without leaving the di*scussion activity. 
Once 'tphe command action is teiken by the program*, you are returned to 
the ongoing discussion, having never really left the activity. 

2. At any point in the program, you may go to the upper-level command mode 
(in which you have a full set of FORUM commands) by striking the ESCape 
or ALTmode key. This conmand mode removes you from any conference ac- 
tivity you are participating in and prints a prompt to your terminal as 



After the command action is completed, you are either returned to the 
command mode (indicated by another "COMMAND?" prompt) , or to an activity 
at which the command given will explicitly place you. For example: 

COMMAND? 

* |^(to activity) l2[CR]| 



|(l to|SMITrf)|[CR]l 




Commands 



follows : 



COMMAND? 



* 




-74- 



USER FUNCTIONS 



Getting Help from FORUM 



If you are not sure what action to take at any time during a FORUM confer- 
ence, strike the question mark key [?] as your first letter of input. 



To Leave FORUM 

X • 

To end your participation in FORUM, simply hang up your telephone. If you 
want to r<Kpain on the network in non-FORUM-related work, send the following 
private message to FORUM itself: 



- IQUIT [CRI 



Or, if you are in the upper level command mode: 
C OMMAND ? 

You will then be placed into the TENEX executive. 



Moving from One Activity to Another 

To leav6 one discussion activity and go to another in the same conference, 
you may do either one of the following. 

1-/ 



Send a private message to FORUM and use the speci^^e^rvice requests 
"GO (to activity) N" , "NEXT (activity)", or "PREVIOUS (activity^" 



2. Strike the ESCape or ALTmode key and, after receiving a "COMMAND? ^ 
prompt, use the same commands listed above. ■ 

For example: 



Qto^^JCRj 
- InextI (activitv)|[CR 



or 



[H where ESCape or ALTmode key is typed 

C OMMAND ? 

* iNEXTj (activity) [TcrI] 



Editing* Entries 

1 

Strike thfe back arrow to. erase the last character v^ich you typed. If you 
strike the back arrow several ^times, the corresponding number of characters 
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will be erased. (Be sure to count blank spaces between words as characters 
when doing this.) 

Strike the DEL or RUBOUT key twice to erase an entire entry. For users ac- 
quainted with TENEX conventions, the control character operations for pro- 
gram control and editing are accepted within FORUM. 

Stopping Output 

You may stop output to your terminal by striking the DEL or RUBOUT key twice. 
The FORUM program will stop printing the current block of text and continue 
with the next operation. 



C. SPECIAL FORUM SERVICES 

While in a discussion activity, you may gain access to certain special FORUM 
services by sending a private message to FORUM itself. To obtain a list of 
available services, send the following message: 



For your convenience, each service is described below. End service request 
with one carriage return [CR] . 

1 DESCRIBE 



2. STATVr. (of participants) 

Provides you with a list of the people registered in the conference in 
v^ich you are participating and the current status of each one. 

3. SUBMIT (file) 

Inserts the. text file you Specify as your next entry in the discussion. 
For example: 




Explains the use of the other services on the list. For example: 



f(l to |F0Ru4i[CR]| 

- IDESCRIBE REVIEW [CR]| 




ii 
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- [SUBMIT I Cfile) f^gF^LE.TXT [CR]( where "MYFILE" is the 

Your file has been submitted as entry [40] name of ^ text file 

REVIEW (entries) \ 

Retrieves and displays the entries you specify. You may use any of the 
following options, alone or in combination: 

a. "BY*' and a list of participant names (or the word "ALL") - For 
example : V 



(Il to |FORUMt >|[CR 



- iREVIEW 



(entries) . |BY SMITH [CRH 



or 



ni to tFORUI>l ) |rCR]I 

- IREVIEW 1 ( entries) IbY SftlTH AND LEE [CR]j 
b; "IN" and a list of entry numbers (or the word "ALL"). For example: 



E ko lFORU^^ ) ^[CRij 



(reviEV^ (entries) |IN 2,5-9,14 [CRj 



c- "LAST N" entries (to see" only the previous entry, simply type "LAST") 
For example; 

|3t0^goro3>IicR]J N 

- IREVIEW [ (entries) IlAST 3[CR][ \ ^ 

d. "BEFORE", "ON", or "AFTER" a date. For example: 



Rl to tFORU^^|[CR]| 



IREVIEW l ( entries) IbeFORE 17-APR-73 ^CR]1 



or 



Rl to |jFORUMl > |[CR]} 
- iREVIEW "(entri 



Les) jON 4/17/74 [CR]| 



e. "RE" and a text string in quotation marks. For example: 



f3 to IforunA|[cr]| 

- IrEVIEW 1 ( entries) |R£ "ENERGY" [CR]| 



The program will retrieve all entries in the current discussion ac- 
tivity containing that text string. 

If you do not wish to review the complete heading and text of the en- 
tries you have specified, you may use any of the following restrictions, 
alone or in combination: 



He 

* i 

2^ 
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a. "BY FIRST LINE" or "BY FIRST N LINES" 



b. "NO HEADING" 
C* "NO TEXT" 



this suppresses the printing 
of the author's name, date, 
time stamp 



For example: 



^ ^^lEW K entries) |BY SMITH BY FIRST 3 LInAs [crU 



or 




^lEWK entries) pY SMITH Otl 4/17/73 NO HEADING [CR] 
5. " SAVE (entries) 



Saves the entries you specify by placing thei|Mii"the TENEX text file you 
name. To specify the entries, you may uge^ny of the pptions lis^ted 
above under REVIEW (entries) ^ For ejccwiple: 



H bo |FOmJI>j ) |[CR]| ..^^ 

- bAVE gentries) [by SMITH [CR]| 
in IFimM.TXT [CR]| (New File)' |[CR] j 



\ 



confiinpn that this is d new 
file by typing one carriage 
return [CR] 



Note that FILNM is the ncune given to the file for this example. ^ 

To append entries to an existing text file, you must rpecify the file 
name and the version number of that existing file* \ For example: 




— JEijl ^ 

- ISAVE Gentries) pY J0NES[CR]| . 
- in [FIIJ4M.TXT;l[CR]f (Old Version) |[CR] 



confirm 1:hat you are adding 
entries to the old version 
of the file by typing one 
carriage return [CR] 

The program will take the file containing the entries made by Smith and 
append the entries made by Jones. ^ 

/ 

/ . 

6* GO (to activity) 

Puts you into the activity in the conference which you specify* For 
example : 



[3 to ^*qrum||[cr3| 

- IGO K to activity) |2[CR]| 



ERIC 
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The title of rhe conference is 
Department Directors Meetinq 

Background information 

This conference will i*nclude discuislon and inforrwtipp related to the 
meeting of department directors. 

The participants in fhe conference are 

k' Ndtne ' Status 

1 Smith (Chrfnn) not on-^ine' 

2 Jone9 not on- I ine 

The tof>ics in the agcnda are; 

1 Budget estimates 
.,2 Feedback from budget estimates 

3 Discussions of new projects that should be added in the next year. 



Name 

^ Brown 
Green 



Status 

ifot on-line 
en^er i ng 



Agenda top i c 1 ^ 
Budget estimates 

Activi ty 1 1 ^ 1 > 

What i s your hi gh es t irnale for the anxiunt of fund ing you will n^cd for 
project operation^ this year? Answer in thousands of dollars 



Activity 1.3 

We would liko**5'bu to forecast our budgetary needs for the year 1^76 (m 
thousands of dollars), using a probab i 1 Is t f c approach to determine the 
range of forecast and median value 

Because of the uncertainty m this answer we would like to establish a 
range of possible values Firs>«, please try to estimate a value so low 
that you feel there is only one chance tn ten that the actual va'ue will 
turn out to be even lower. 

K 350 

Now try to estimate a value so high thai you feel there is only one 
chaoce in ten that the actual value will turn out to be even higher 

# 600 

Using your high and low estimates, we can construct the range in which 
you feet there are eight chances in ten that the actual value will fall. 
We would now like to know how these chances ar^*^ i i-trlbuted through the 
range. If we divided the range as shown 

LErr RIGHT 
350 ' ^75 ^' 

and you had to wager that the actual value of the variable would fall m 
orfe of the two segments of the above range, which segment would you 
choose? Please type L for th,; liH segment"., R for fhe RIGHT segment,, or 
strike only the CR '^ey you can't decide ^ 



Figure 14. Information Elicitation in a FORUM Conference 



7. 



NEXT (activity) 



Puts you into the next activity on the agenda. For example, if you are 
in activity 2 .and want to move to activity 3, type: 

[3 bo boRU^ ffcRll 

- [nextI (activity) [[CRU 



8. PREVIOUS (activity J 

Returns you to the activity preceding your current oue. For excunple, 
if you are in activity 2 and want to return to activity 1, type: 

[(I bo (foRU , 

- (previous 



mi 

(activity) KCR] 



J 01 N ( gonf erence) 

Allows you to move from one conference to another. If you would like 
a list of available conferences, follow the "JOIN (conference) " request 
with a q[uestion mark [?] . For ex,ample: 



- (JOIN If conference) |2 [CR]| 
or 

H Ko iFORUtAjlCRli 
- IjoIN [ (conference) [?] 

An example of special service use while in a discussion is shown below: 



[67] HENRY (CHRMN) 

- If everyone has the exact proposal in front of him (entries 

- k2-kS y I think), perhaps we should b^se oui discussion there 

- for the sake of preci s ion . [CR] ^ 

- [CR] ' \ 

\ 

(to FORUM) [CR] 

- REVIEW (entries) kl-kSlCR] 

[k2] HENRY (CHRMN) FR| 21-DEC-73 3:^8 PM 

I am now finishing a short paper describing the next 6 months of re- 
search with FORUM. I'll be getting copies of this to al 1 of you, and 
perhaps we can critique it in this conference. OK? 

[^3] HENRY (CHRMN) MON 24-DEC-73 10:^5 AM 
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^ctlvlty 2.3 

The group's aggregated forecast for the total budget in 1976 will be fed 
back in graph form as a probability density function over the range of 
forecast budgets.^ > ^ 

Display of probability estimates from Activity 1.3 

We would like you to forecast our budgetary needs for the year 1976 (in 
thousands of dollars) » using a probabilistic approach to determine the 
range of forecast and the median value.^ 
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Figure 15. Display of Probability Estlniates 
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FORUM's Upper Level Conunand Mode 

To leave a discussion activity and reach FORUM'S full conunand mode, strike 
the Escape or ALTroode key. To obtain a li^st of available conmcmds, strike 
the question mark key [?] . For your convenience, the commands are listed 
below. Several of these can also be reached as special FORUM services and 
are described there. Note that while special services allow you to input 
ccDunands without leaving the discussion activity, the upper level command 
mode prompts you with: 

^ comJbvnd? 

* 

You do not have to send a private message to FORUM; rather, simply input the 
coinnand, followed by one carriage return [CR] . 

1. DESCRIBE 
See page 75. 

2. CONFERENCE (information) 

Provides you with any background information submitted by the chairman 
of the conference in which you are participating. 

J. AGENDA (information) 

* Provides you with the complete agenda for the conference in which you 
. are participating- % ' 

' >*' 
4. ACTIVITY (information) 



Provides you with any background information on the conference activity 
in which yon Are participating.*' 

'5. STATUS (of^ participants) 

See page 75: " 

6. CONTINUE 

Returns you to the activity in which you were participating prior to 
entering command mode. ^/ 

7 . GO (to activity) ^ 
See page 77. 

8. NEXT (activity) 
See page 79. 
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9. PREVIOUS (activity) 
See page 79. 
10* PRINT (transcript for activities) 

Provides a transcript of the activities you specify. For example; 
COMf^ND? 

* [print J ( transcript for activities) ll^2,3[CR] 



SAVE (transcript for activities) 

Saves the responses for the activities you specify by placing them m 
the TENEX file you name. For example: 



C OMMAND? 

* ISAVE ktranscript for activities ) tALL[CR]| 
in file MYFILE^TXT [CR] !" (New File) |[CR]'r 

{ 



confirm that this is a 
new file by t?^ping one 
carriage return [CR] 

Note that MYFILE is the name given to the file for this example. ^ 

.12. _ message: ,(to participants) ' i 

Lets you send a private message to anyone registered in the conference 
m which you are participating. After you have specified the name of 
the recii^ient, strike the carriage return key [CR] once, FORUM will 
prompt you to begin typing your message. To end the entry, strike the 
' 'carnage return key [CR] twice. For example; 

COMMAND? 



MESSAGE kto participants) ISMITH AND LEE [CR]1 



The re will be a meeting at 4; 00 pm today. [CR]| 

- tCRjl ^^^^^^ 



13. RESTART 

Puts you at the beginning of the conference and lets you begin your ac- 
tivities again. 

14. JOIN (conference) 



See page 79. 
25. QUIT 

See page 74 . 
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D. CHAIRMAN FUNCTIONS 



Release 5 of FORUM hAs restrictions placed on the use of the CHAIRMAN pro- 
gram. The CHAIRMAN program is essentially the FORUM program with additional 
commands included in the upper level command mode. These additional com- 
mands are concerned with the creation, modification, and monitoring of con- 
ferences. The CHAIRMAN program will be modified significantly in release 6 
of FORUM. 



Entering Chairman 

By issuing the following to the TENEX executive, you may run the CHAIRMAN 
program and have all the chairman capabilities in all conferences to which 
you have access, no matter whether you are the titular chairman or have 
set that conference up. During the log-m procedure, issue the conmand: 

^DIRECTORY NAME>CHAIRMAN [GR]| 
Creating a Conference 

At any point after logging in and selecting a conference, you may go into 
the upper-level command mode by striking the ESCape or ALTmode key. Upon 
receiving the "COMMAND?" prompt, issue the "SETUP conference" command. For 
example ? 

CC yiMAND? 

* (setup] ( confer ence) |[CR]i 

This will call the SETUP program, a sequential process that must not be in- 
terrupted once it is begun. If errors are made during the process, they 
should.be corrected after the conference is completed, using the modifica- 
tion commands described later. 

1. Entering Names of Participants 

Tha program will prompt you with: 

V PleasG enter the last names of the participants: 
Participant # 1 (CHRMN) : 

At this point, type the last name of the persoh who is to act as chair- 
man, followed by one carriage return [CR] . You will then be prompted 
for the name of the second participant. You may continue to add names 
and will be prc«npted similarly each time* To indicate that no more 
participants are to be included, strike the carriage return key [CR] 
once when yoii are X)rompted for a name* For example: • 
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fou are currently not In any conference and are now free to work in the 
command mode. Please type 7 If you wfsh a' list of your available commands. 

Command? 

*setup (conference) 

Please enter the last names of the participants:: 

Participant #1 (Chrmn): Smith 

Participant 12; Jones 

Participant #3: Brown 

Participant 0k: Green 
Participant 1$: 

Oo you wish to allow guests? 

\ 

Please type a one-liVie descriptive title for the conference. . 

- System Design Conference 

Oo you wish to provide the participants with background information on the 
conference as a whole? 

- y 

Please enter the background information. 

- This conference consists of one discussion activity, to which the 

- CHAIRMAN may add more activities later or keep as it is. 

Do you wish to create an outline of topics which will be used as an agenda? 

y 



Figure 16. Setting Up a FORUM Conference 
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Please enter the last nam es of the participants 

c^4.4^4^^«4. 4k 1 inur^tn.i\ . \ Lee ICR]| 



Participant # 1 (CHRMN) 
Pcirticipant # 2 
Participant # 3 
Participant # 4 
Participant # 5 



Smith [CR] 
Jones [CrI 



Brown [CR] 



[CRlf 



2, Privacy of Conference 

You will then be prompted with: 
Do you wish to allow guests? 



mm 



By typing •'N" (signifying "NO"), you have restricted conference attend- 
emce only to those participants you have explicitly named in step 1, 
or those inserted into the participant list using the "INSERT PARTICI- 
PANT" canmand (see page 93). By typing "Y" (signifying "YES"), any 
user of the FORUM program may attend this conferejice and, if electing 
to do so, will be entered into the participant list by FORUM itself. 
/ 

Title of the Conference 



You will next be prccipted with: 

P lease type a one-line descriptive tiule fo r tiie conference. 
- iDjmonstration of the CHAIRMAN program [CR^ ^ 

This title may be longer than one line, but only the first line wiih^ be 
shown to participants when they are asked %^ich conference they wish\to 
attend. The title is ended by typing one carriage return [CR] « 



4. 



Background Information on Conference 
You will then be prompted with: 



\ 



Do you wish to prov'de the participants with background information 

on the conference aL a whole: 

- |Y[CR]| 

The' "Ves" response will then cause the program to ask: 

P lease enter the background information. 



This is a conference set up solely tor the purpose of demonstra-| 
tion* It should show the new ^airman the means he has at hisf ^ 
disp osal by which he can create a conference . [CR]| 
'CR]J~ 



The background information for the conference will be printed out to 
the participant's terminal after the title is printed. This allows the 
chairman to offer prefatory remarks on the purpose of the conference, 
etc . 
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Figure 17> Setting Up a Conference Agenda 

ERIC • ^ 



If you respond "NO" to the initial prompt, the program will go on to 
step 5. 



5. Creation of the Conference Structure 
a. Next, you will be pronpted: 



Do you wish to create an outline of topics which will be used 
as an agenda during tlie conference? 

- iyIcru 

It is -not mandatory that you create the outline^ structure. You 
can elect to create only activity items that will be structured 
sequentially and with integer item numbers. By specifying "YES"^ 
you provide the participant with a division of the conference 
v^ich will be printed out when he enters the conference* If "NO" 
is specified, the program will go to step 6. In the example, the 
chairman has elected to create an outline. 



Please enter one-line descriptions of the main agenda topics. 

P lease enter agenda topic 1 

^ {Demonstration of the discussion activity [CR]| 

P lease enter agenda topic 2 . 

- pemonstration of other information elicitation ac tivi ties[CR] 
Pl ease enter agenda topic 3 

^- Ecm 

By typing one carriage return [CR] , the chairman signifies that 

there are no more main divisions to be made. This structure can 

be modified later using the "INSERT ACTIVITY" command (see page 94). 

b. At this point, the demonstration conference contains only two 

agenda items, or divisions, and no activities such as discussions 
or number elicitations. The agenda items can be considered only 
as "placeholders" or labeled dividers. You v/ill then be prompted 
with: 

D o you w ish to include subtopics in the agenda? 
- iY[CR]| 

This gives the chairman the opportunity to further subdivide the 
conference by dividing the main agenda items into subtopics. If 
*'N0" is specified, the program goes to step 6. 

Please enter the numbers of the agenda topics for which you 
wish to include subtopics ♦ If you do not wish to incluie more 
s ubtopi cs , strike only the CR key. 
# ri[CRil 

Please enter one-line descriptions of the main agenda topics. 
♦ 
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^Plca$c enter the instructions and response formats for the specific 
activities to be performed under each topic and/or subtopic during the 
conference. 

I Budget estimates 

Please enter the instructions for activity 1 I 

" What is your high estimate for the ansount of funding you will need for 
project operations this year? Answer in thousands of dollars 

Response fortrvit? number 
Response forft«t? ^ 

Please enter the instructions for activity 1 2 

What Is your low esitmate for the amount of funding you will need this 
> year'' Answer in thousands of dollars. 



Response fornat? 
Response fornat? 



number 



Please enter the instructions for activity I 3 

- We would like you to forecast our budgetary needs for 1976 (in thousands 

- of do liars) using a probab i 1 1 st i c app roach to determine tne range of 
'"^ forecast and the rpedtan value. 



Response forrrwit? probabi I ity 

Please indicate the ma;<imuiTi value of the variable. 

750 .LoH'eif 01 minimum va^ue a oAiumeJ fc be re to. 



Figure 18, Setting Up Activities within an Agenda 
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P lease enter agenda topic 1,1 

- ^The first discussion [CrT] 
P lease enter agenda topic 1 . 2 

- frhe second discussion [CR]j 
P lease enter agenda topic 1.3 

-CcrII 



Please enter the numbers of the agenda topics for which\^ou 
wish to include subtopics. If you do hot wish to include more 
subtopics, strike only the CR key. 

# HcrU 



In the preceding example, the chairman has elected to subdivide 
agenda item 1 into two subtopics. (He specified that he did not 
want an item 1.3 by typing one carriage return [CR] .) The program 
then prompted him to determine if any other agenda item was to be 
subdivided. At this point, the chairman could have subdivided 
agenda item 2 or either of the' subtopics created above (i.e., item l 
1.1 or 1.2). Instead, the/Ctiairman elected to make no more subdi- 
visions. Thusr the sample conference structure now consists of 
the following agenda items and no activity items. (The following 
message will be printed on an entering participant's terminal.) 

The topics in the agenda are: 

1 Demonstration of the discussion activity- 

1.1 The first discussion 

1.2 The second ,vdiscussion 

2 Demonstration of other infoinnation-elicitation activities 

you will then be prompted: 

Do you wish to provide background information on specific 
a genda t opics? 

If '*YES" is specified, the program will ask for the agenda item num- 
ber to which you wish to supply background information and then as^ 
for the text. It will keep asking for agenda item numbers unt:^^ you 
type one carriage return [CR] , signifying no more backgrgund infor- 
mation is to be placed into agenda items. 



6, Creation of Activity Items 

At this point in the process, you will be prompted: 



\ 



Please enter the i-nst^ructions and. response formats for the specific 
activities to be performed under each topic and/or subtopic during 
the ccafercilce. • * " 

1 , Demonstration of the discussion actl^T^ty 
1,1 The first discussion 
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Please enter the instructions for activity 1.1.1 



This is the first discussion of this conference. I have sub 
divided t he first main topic heading for demonstration pur 
pose s. [CR]][ 
[CR] 



Response format? I pISCUSSION [CR]1 
Response format? ltCR]| 



Notice that the progr^ prints the conference outline structure and 
then prompts for the instructions of the firsjt activity, which is a 
subdivision of^the lowest agenda item (in this case item 1^1). The 
"Response format?" prompt asks the chairman what sort of information 
will be elicited in this activity. The options- are: 



1) "DISCUSSION" \ 

2) "ESSAY"' \ 

3) '"NUMBER" < 

4) ''PROBABILITY" 

5) , A feedback option, "SUMMARY (results from actiMip^) [ACTIVITY 

ITEM #]" - _ 



To clarify the procedure knd the various response formats, the rest of ) 
the "SETUP conference" process for the demonstration conference is shown 
below: 

Please enter the instr^icti'ohs for activity 1.1.2 

- |[CR]j (indica4;ii;g nq fu'rther activities binder agenda item 1.1) 



1.2 The second discussion 

Please enter the instructions for activity 1.2.1 



This is the second dfis^cussion. By setting ub a 'series of | 
discussions/ a chairman may divide the topics of conversation! 
or provide separate'-tne^ting rooms for subgroups in the j 
conf erence. [CR]j \ ' ' i 



Response format? IpISCUSSlbN [CR]} 

Response format? |[CR] | - 1 ^ 

V 

P lease enter the* instructions for activity 1.2.2 ^ 

1 

2 Demonstration of other ^irif ormation elicitation activities 

j 

Please enter the insttu gtij^ns ^or activity 2.1 



( 



This is an ex^ple of^the numerical-infomation elicjta tionj 
ac ti vity. I might ask, ^'What is the sum of 6,+ 31>"ICR]{ 

jcRij : 



/ 
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Response format? | NUMBER [CR]| 
esponse format? 



P lease enter the instructions for activity 2.2 

r [This is the "ESSAY" format. I might want ^ short answer which | 

- will NOT be distributed to the other participants in this ( 
*- discussion until I wish the_program to display the answers. 

- The question 1 might ask is, "Please write a short position 



paper giving your stance on the p roposed School l:yond election ." [CR]) 
[CR]f~^ 

Response format? [eSSAY [CR] 



Response format? |[CR] | 
Please entey the instructions for. activity 2.3 



This i^^a demonstration the probability-el icitation format 
which goes through an ^^terative procjedure to obtain estimates 
of some numerical value, but which ar^ uncertain for theQ 
respondent. For example, I might asl/, "Please estimate the 
distance between San Jose and San Francisco, California (in 



mile s) ." [CR]| " 
[CRlf 



Response foymat? (PROBABILITY [CR] | 

P lease in dioate the maximum valu^ of the variable < 

# [200 [CR]| 

Response format? |[CR]| 

Please enter the instructions for activity 2.4 



This will demonstrate the feedback mechanisms to which you havej 
access . "SUMMARY, results" of a discussion will print the fulir^ 



tra nscript. [CR]| 
[CR][ 



Response format? 
Response format? 
Response format? 
Response format? 



SUMMARY 



SUMM ARY 
SUM^RY 



JtCRj 



(results from activity) 
(results frcxn activity) 
(results from activity) 



2 


.1[CR] 


2 


.2[CR] 


2 


. 3[CR] 



'please enter the instructions for activity 2.% ' ' ♦ 

- | [CR ]J indicates that there ar'^e no more 

activity items under -agenda item 2 

The "SETUP conference" procedure will then ask for backgrpund informa- 
tion since there are no more agenda items under which to place activity 
i terns . ■ i 

! 

Do you wish to provide background information on any of these ^ 
activities? 



N[CR]| 



COMMAND? 



/ 

/ 

/ 



\ 
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The process is now ,oanplete/ and* the chairman has been returned to the 
upper-level command mode. 



CHAIRMAN UPPER-LEVEL COMM?^ND MODE 

At any point in the CHAIRMAN program (except during the "SETUP conference" 
procedujre) , the user may reach the full, command mode by striking the ESCape 
or ALTmode key. To obtain a list pf available commands/ strike the 'ques- 
tion" mark key.f?]. For your convenience/ the comrtiands to which the CHAIR- 
MAN program has access are listed below. In additipn to these commands, 
the CHAIItfiAN program has access to aM of the commands of the FORUM program^- 
The upper level command mode prompts yotKWith; 



COMMAND? 



You m^y then ty^ -the command/ followed by one carriage return [CR] . 

I. CLOSE'-' (discussion at activity) [ACTIVITY ITEM it] 
(for participant^! 'LPAkTlCl'PANT NAMES or "ALL^'] 

.Will 'prevent a participant who is not using the CHAIRMAN program- from 
•entering or 2;eviewing ato activity with the "DISCUSSION" fomat. " For 
• .example/ if the chairman gives the following commarld: 



* . * IClJQSjfel (discissio n at act ivity) |l.l.l[CR]| 
.(for participants) |aLL[CR]} 

all participants except those using CHAIRMAN will receive the message: 



Acti^iity 1.1.1 ^ ' • 

This IS the first discussion of this .conference. I have subdivided 
the f irs't' main topic heading for demonstration purposes . 

/ 

The discussion on this subject is now closed. 



and will be ti^ansferred to the next item automatically, 

OPEN (discussion at activity) [ACTIVITY ITEM 
(for participants) [PARTICIPANT NAMES or "ALL"] 

Will reactivate a discussion for those participants dejsignated after the 
"CLOSE (discussion at activity)" command has been given. Note that when 
a disctission activity is created in the "SETUP conference" process, the 
default is that the discussion is open to all participants. 



ERLC 



S8 



DELETE (ftctlvitg) [ACTIVITY ITEM »J 
^' (for participants) [pjmTICIPANT NAMES or "ALL"] 

Wili%elete the activity from all the designated agendas • The FORUM and 
^CaAIBMAN programs will not know of the existence of the. designated ac- - 
tivity or agenda item, . ^ , 

^ ^ UNDELETE (activity) [ACTIVITY ITEM' H] 

(fox participants) [PARTICIPANT NAMES or "ALL"] v* 

Will reinstate the item designated ii^the agendas of the participants 
named after tljp "UNDELETE (activity )^^oninand is given. 

Feedback [subcommand] * . . ^ 

This wili allbw you to have the summary results of an activity printed 
to your fterminal, if you type; 

* IfeEDBA CK p rint) (summary results from £|f:tivity) {[ACTIVITY I1EM #1[CR]| 

S ' ■ ^ . ■ _^ . , ^ \ 

Or, it will allow you to have the suirmary results fed back to all par^ilbi— 
pants in an existing activity, if you type: f 

C OMMAND? \ ^/ * 0 1_ < - 

^ IfeEDBACK SUMMARyI ( results frcm activity) ([ACTIVITY ITEM #] [CRl{ ^ ' ^ 
(under/at activity) | [ACTIVITY ITEM #] [CRll 

,This sedond option does the same thine, as specifying: 

Response fomat? .SUMMA-RY (results from activity), fACTIVITY ITEM #]" 

^ i n the "SETUP conference" process • ' «^ ^ 

• SETUP (conference) . / ' ' ' ' 

, ^ * d 

See the section entitled "Creation of 'the Coitference Structure?* ,on page 87. 

. -• ' . ^ , ... 

, INSEPT [SUBCOMMAND] 

The optional subcommands are listed belpw. 
a.'.' INSEPT BACKGROUND (for item) [ITEM if] 

Will aslc for the item number and then prompt for the background text. 



i 

INSERT PARTICIPANT [C 



Will. give you the next free participant number and ask for his/her 
last name. For example; 



s 
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C OMMAND? , 

. * llNJSERT PARTICIPANT [CRIJ 
Participant # 5: limME] [CR3| 

If you wish to change the name of a participant already ^specified, v. 
type the participant name rather than a carriage return,. For example, 
for the sample. conference: 



C OMMAND? ^ 

* [IN^RT PARTICIPANT MILLER [CR] 



will -cause the program to prompt: 



• Participant # 1 (CHRI^) : ITnEW NAME] [CR]] 
INSERT AGENDA (topic) [AGEJNDA ITEM #J i. 

Will allow you to acjd a new agenda item with the*nurober specified 
anA ask for the one-line d€;scriptive title or, if you specfify an 
already existing agenda;,item, it will ailow you to replace th^ 
text of the on-line title for 'that item. ; 



d. INSERT ACTIVITY^ [ACTIVITY ITEM 



,0 



Will allow yciu ta' add a new actA^y item, will prompt you for the 
text 'and the response format, or will allow you to replace an ai- 
readt; existing' activity with a ne^ set of instructions and response 
formats , ' . ^ 

8.' ASSIGN (activity- schedules for participants) [PfiRTTCIPANT NAMES or "ALL"] 

- Whwan yo\f ' insert ^a new agerada or ^^^qtiv'ity item (i-e., add a new item num- 
^ber to the agenda; , you fiave olily altered a master agenda but not tlje 
agendas of individual *parbicipants^. For new items to be added to the 
r s^qjaence of "events of paftibi^ants, you xi^st assign new activity ' sched- 
' ules for those^tc whom tile- changes '"made by insertion should apply. 



< ■ 



APPENDIX 2: PRCXiRAM ORGANIZATLC^I AND PERFORMANCE 

A, GENERAL STRUCTURE ^ 

This feection deals with. th^ performance of the current version (FORUM-5) 
and with, the specifications for the future versions of the pdRUM program as 
a medium of interpersonal communication, which may operate in real time or, 
by means of mes^nge^storage, as a delayed message-distribution system. Like 
earlier versions , FORUM-6 functions as an information-elicitation devibe 
\^ich administers online questionnaires, processes the answers, and, under 
the control .of' the activity organizer, feeds back the participants' answers • 
The third function of FORUM is that of a limited information storage and re- 
trieval system. The data base may include conversations heid using this me- 
dium, questioyiaire data, or personal data bases such as bi^iographies, 
note pads, and so forth'T'^h^ overall .organization of the planned system is 
shown in Figure 19% As c^n.be seen,^ an activiti^ has a title and contents, 
possibly b^ken into parts that may represent a C9mplete trfee structure, 
T\ie smallest unit of information accessitle to^the user is an entry • An en- 
try lias a number, an author name (possibly "Anonymous") ,% date/tinie stamp, 
and text. * • * 

In the future vprsion of FORUM^ there will be two participant roles, 
organizer and. part icij^ant, The^prpgram structure, is Accordingly ba^ed on' 
levels of access to an ac^iyity:' the ORGANIZER program will, have total con- 
trol over participant 'roles and text, , The REPORTER program provides moni- . 
toring data'- (of a primitive nature at this stag*) and the EDITOR program 
manipulates the contents of an activity. Participants run* the USER 'program 
that can be placedj in corrector mode by hitting the ESCape or ALTmbde H^Y; " 

Formally described, the FORUM. USER program can be represented as a 
finite-state machinel Figure 20 is a .simpl^ied diagram of the ten states 
or^modes into which the *FORUM .program can currently be placed* These are 
as follows : \ • \ ' * 
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ORGANIZER 



REPORTER 



EDITOR 



USER 



ACTIVITY 



PARTICIPANTS 



TITLE 



CONTENTS 



PART 1 




3 I P Airr ^*^ I 



PART 4.. 1 



PART 2.2- 



h 

I,* 



TReI- STRUCTURE 



I ENTRYj^O l I ENTRY (2) | 1 ENTRY. (3)-| 



CORRECTOR 




1 TEXT, . 





E 



AUTHOR 



I 



NUMBER 



I 



DAtE/TIME 



]' 



Figure 19, General Concepts for|an Advanced Version of FORUM 
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= idle mode 



s = feedback questionnaire (restricted format, single recipient) 

< 1 ^ • 

S;^ =' asynchronous directed (one user, specific topic)' 
s^ = asynchronous free » ^ 

= synchronous ^directed (specific topic, simultaneous discussion) 



^4 



ir- 



s^ = synchronous free ' ' . 

s^ = private message mode , ^ 

s^ = anonymous mode * ^ 

♦ 

So ^ "whisper" to FORUM , ' ; 

s* »= -'whisper" to EXEC . ' ^ . - \ - 

y * ' ^ * \ *' 

In the idle mode/ participants can review their own private-message ^ile 
send private messages to others, and display activity states. The feedback- 
questionnaire ©tate corres^nds to the administration by fORUM of a list o^ 
pre-specif ied 'questions. The asynchronous states cire thosja in which the 
ticipant is the only user of a given conference ''by^contfast with the syn- 
chronous states in which others are involved in real time. In the J>*isper** 
m9des coxwnunication is not with other human participants but with systems. , 

To illustrate this process, let us take the example of a user who i5 | 

engaged in a free synchronous 'discussion mode (state s^) . Here any parti'ci-i- 

pant can send a message to any other with no tqpical restriction.*^ Let us 

assume that he now types a left parenthesis as the first character of an en- 

» 

try and follows it with the full command: 

' ' (to FORUM) REVIEW ALL^ 

The single parenthesis would be recognized as an input that triggers the 

transition to another state, in this case s^ate s^ (privat^ message mode), 

where the recipient is a subgroup. The name of the recipient, however, is 

FORUM itself, which results in another transition, this ^time to the state 

s , where th* recipient is the system and where the fqrmat is that of a com- 

8 , • 

mand that must follow the FORUM syntax. 
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We will s^e below how the same example will be processed by the vari- 
ous modules in the release 6 program. 

Although this formal description of FORUM is highly simplified, it does 
convey on^ important point: in future as well*as in current versifnsi, the 
participant in a FORUM discussion has control over a wide range. of operation 
modes, and the transitions between these modes involve the range of partici- 
pation, the nature of the topics, the format ,"^nd other parameters • 

The simplified state diagram of Figure 20 sho^s that the FORUM concept 
allows direct transitions between asynchronous and ''synchronous usage and 
never "locks" the user inside a particular mode, except in the special ca^e 
of a questionnaire with feedback, where the^ user environment is*purposely 
constrained. 

The next two sections will describe how these functions are actually 
accomplished and what specific problems have been encountered. 

i 

t ^ . 

B» PROGRAM MODULES " 

The various programs that correspond to the operation modes of FORUM 
are written entirely 'in assembly language and run under the TENEX timeshai;,- 
ing systera on PDP-10 conputers. (Note: A version of FORUM-5 n^nning xinder 
th^ TOPTS-10 operating system i^ currently being implemented by the Insti- 
tute for the Future.) There were several considerations that led to the 
choice of assembly language rather than a higher-level language (such as 

FORTRAN 9r PL-1) • First, the available higher-level languages have been 
♦ 

written for specific purpQses that do not include remote conferencing. 
Thus, if we had chosen a higher-level language, we could hav^ obtained a 
working program faster, but in -the long run, we might have been* constrained 
by the language itself and been severely limited in our efforts to imple- 
ment the basic components of this teleconferencing medium at the level of 
detail that we required. The ability to control both input fran the user 
and output to him was a basic need: features such as editing capability 
and paging for CRT terminals require a detailed control of the input/output 
nonitor calls. The most important consideration in, selecting an implementa- 
tipn language was that teleconferencing by computer involves communication 

1 • 'O 



r 
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between patallel running job^. The dnly practical way to achieve this is 
through shared files • Since the' conventional file machinery of most sys- 
,tems is geared to the one user/one file concept, we were forced tb bypass 
the available high-level mechanisms and build bur own file-access system 
using the primitive monitor calls. At this writing, FORUM is the only con- 
ferencing systeii in existence that uses files. that are shared in real time. 
This file-access system is explained further in Section C. 

Assembly language also allows more efficient use of computer resources 
than do most higher-level languages. FORUM is completely reentrant so that 
-not only participants in the seime activity but also those in other activi- 
ties use the same copy of the program. Moreover, FORUM is almost entirely 
input/outputporiented, oif "I/O-bound". The implementation of the FOFUM pro- 
gram in assembly language has allowed an efficient connect ti.me to CPU time 
ratio, providing a low usage-demand on the host computer while giving good 
user/computer re^sponse times under heavy machine loads. As will be seen^in 
Section D, where the results of an analysis effort are repo. bd, FORUM typi- 
cally uses one minute of PDP-10 computer time for every two hours of >eonfer- 
encing (per participant) . Similar performance figures^ are expected undef* 
FORUM-6. / , ' 

The FORUM-6 progrcun is designed to run on a standard time-sharing sys- 
tem as a user prograun or eventually as a. subsystem of the pperS^ting system 
itself ♦ It consists of approximately 1^0 separate assembly-language subrou- 
tines which make up its executive program, five subsystems, and three^utilr 
ity libraries* The subroutines communicate with one another by means of .the 
PDP-10 's twenty accumulators^, the shared files described later, a hardware- 
implemented pushdown stack indexed by accumulator 17 (reserved fop this pur- 
pose) , and the private memory space allocated to the job running the FORUM 
progtam* Certain locations in the memory space, are given labels recognized 
by morq than one subroutine so that these locations can also be used for 
passing arguments. • * 

FORUM'*s executive subroutine (box #1 in figure 22) is the first to be- 
gin execution when a participant enters. Its main purpose is to direct the 
partiqipcoit to the activity he wishes to join, as well as to initialize the 
paging control, terminal control features, pseudo-interrupt system, and the 

t; .7 
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Figure- 21. Overall Organization of the FORIJM-6 Program 
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file systeia. Once the participant has decided which activity he wishes to 
join, FORUM transfers control to the appropriate subroutines. 

This module handles the request for user name and password, the user 
recognition, and the terminal being useti; it prompts the participant for 
the number of the activity he wishes to join. The same module also handles 
the leaving procedure and asks the participant v^ether or not he wants to 
join a different activity. 

/ 

' There are five subsystem libraries in FORUM. These elicit, process, 
and transfer infoVmatioa among the participants. The utilities libraries 
provide the functions that are necessary for the five subsystems to communi- 
cate with the participants* These are *^he boxes numbered 7, 8, and 9 in 
Figure 21. / • 

V When the participant has been recogrfized by module #1, coiltro^^is , trans 

f erred into one of the five subsystem libraries based on infoipfnation In the 

\ / ' ' I 

control file created by the oirganizer.^ Generally this will- be to'" module #3 

(discussion) where the interaclSive routine is stored. PROGRAM' CONTROL (#9) 

contains most. of the command rdutines. Some specialized^dmmands , however, 

reside in CREATE AND MODIFY and'bthers that deal with^private messages are 

processed in module #5, but the main command reatSer is in module #9 which 

sends the user back*' to what'^ver program is required. 

Module #1 is used for getting the name and password and joining 
or leaving conferences. When a ua,er leaves one conference to 
joih'anbther, >he is actually sent back to t^^is module,, as if he 
started again. That module contains the routines for resetting 
the status when a user comes into a discussion. * This library ^ 
also contains most of- the subroutines that perform* routine, 
checking operations. / 

Module #2; CREATE AND' MODIFY , is con^^er^ned with the main orga- 
nizer actions. Its main command is tfte "CREATE/activity" com- 
mand which guides the organizer and translates his instruc-^ ^ - 
tigns into A schedule c^f computer instructions that the parti- 
cipant programs will follow. The subsystem also provides cchu- 
mands to modify an existing activity onc^ it has been created. 

Module #3, DISCUSSION, handles the elicitation process given a 
pre-specif ied infonaatiofi format (e.g., number, probability, 
essay, or v<?%e)\ It provides the storage function appropriate" , 
to 'each data type. This subsystem for proce'ssihg information 
also contains the subroutines used for processing and printing 



\ 
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text entries either by command from a participant or under pro- 
gram control. There are four basic types of, processing: tex- 
tual, votes, single numerical estimates, and probability esti- 
mates. The type of processing is chosen automatically by the 
nature of the information being processed. 

Module #4, REVIEW AND FEEDBACK, provides tlie processing of the 
files in response to user ccanmands that require the reorganiza- 
tion and display of previously stored data. * 

Module #5, PRIVATE MESSAGES, handles all- the no* c unmuni- 

cation functions. 

Module #6, STATUS AND DESCRIPTION, processes the request for 
status of participants when called by module #9. If a new user 
comes into a discussion, this information is reflected in the^ 
file and is processed and reported by module #3. There are ac- 
tually thre^ places where a person's status is reflected: (1) 
in the global file that keeps track of whether a person is on- 
line and what activity he's in? (^) the control file indicates 
which part. the user is executing; and finally (3) the part in- 
foignaation indicates who is typing. 



' Module #'7 is the FILE-REFERENCING utility. It contains /subrovi-^ 

tines for storing and retrieving data from the set of three . * ' 

shared files vjsed for each activity. These subroutines ensure 
that participants can both siraultaneously and instantaneously 
read and write entries in these files* 

Module #8 performs the pagination operation that is required on 
outp^ut. All of the terminal input/output operations are Han- 
dled by this utility library. It includes siabroutines for edfit-' 
ing text / printing, and performing special functions for CRT ^ 
terminals. 

9 

Every routine references module #7, so there is horizontal as well as 
vertical communication in the diagram of Figure 21. 

The following example might illustrate the actual flow of control in 
release 6. Assume that a user is in a discussion activity, '^'his input is 
being processed by module #3 until he types a left parenthesis. Let us con- 
sider the case when he type s^ the command: 

' (to FORUM) REVIEW ALL 



*At that point, control is transferred to module #5,' since the left paren- 



thesis as the first character of an, entry ^dicates a private message. 



/ 
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-Module #5 WilJTafcquire the name of the intended recipient. In this 
case, j^t recognizes ^e name FORUM and relinquishes control to^^module #9, 
which reads the conmand "REVIEW" . ^This triggers module #4 (REVIEW AND FEED- 
BApK) , - ^ter completion of the request, control returns to the discus- 
sion m. . « 



DATA STRUCTURES 



FORUM maintains a participant-oriented global file and^^o randcau- 
access, mass-storage files, one which constitutes the data base tor each acr 
tivity and another vrtiich contains an individual participant's private mes- 
sage. The names of these two files are generated by FORUM. A^^l control is 
done internally Jby the program, and the user is not aware of their exist- v 
ence nor th« operations involved in "page mapping", etc* * The two nonglobal 
files are: ^ 

• an activity file, in which all entries and interactions for that#^ 
* particular activity are stored; which contains a master copy of^. ' 

all the items that, make up the activity; and v^ich contains per- 
tinent information on each user in that actiyity (e.g., name, 
' history of use, skill Ratings, and an individualized skeleton of \ 

the cbnference items) 

# a private message file, in which copies of all private messages 
sent and received ey the participant are stored 

' t .> ' ' 

The files are all dynamically expandable; thus FORUM uses the space in these 
files only as it is necessary. Furthermore, since the files the TENEX/ , 
PDP-10 environment are paged, the FORUM program, when loaded running in 
core, does not need to map in the entire file, but rather only ^hose pages 
of the file that are required. (An explanation of this is given in Sec- 
Ntion D) . ^ / 

When tw<^ or more users in a timesharing environment independently de- 
^sire to change the contents of a common' file, some means must be used to 
Insure that their atteiapted changes do'' not interfere with one another. This 
protection against interference in other environments has generally been ac- 
ccxnplished by giving the first user wishir^g to make changes exclusive access 
to the file. In designing FORUM, our desire wa^ to eliminate this restric- 
tive, or "lo'cking-out", type of access. A data-file system which bypasse^ 
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Figure 22. File Structure 



the conventional f,i le protocol w^s developed to allow simultaneous input and 
retriev.al of entries into the data base by as many users as can use the 
computer. 

The data-file system involves accessing a file in discrete pages and 
mapping each page into the user's memory "space as the need arises. Because 
of the TENEX file-sharing capability , each user can then read from the file 
by reading his own memory space. To ensure that users writing simultane- * 
ously into the file cannot print over each other's entries / the first word 
of each file is used as a pointer to the location of the next free space in 
the file. Thus, to write into the file, a person's entry is first buffered 
in his own memory space until it is complete. Then the space for the entry 
is reserved by adding the length of the entry to the free-space word in one 
machine instruction. Finally, the entry is written into the reserved space 
without fear of someone else writing in it also. 

TO permit easy and efficient access to the information stored in the ' 
file, all entries are indexed in a set of directpries. The overall struc- 
ture uses linked-tree addressing to mirx;or the activity-part structure,.^ 
while the directories for each part of the activity are linked directory 
blocks, each of which stoires relevant information on sixteen text entries. 
To increase efficiency further,* these directories are written together at 
the beginning of the file, while the text entries are written together start 
ing at the end of the file ana working backwards. This file structure is il 
lustrated in Figure 22. Although sane of the details of the structure will 
change as the implementation of FORUM-6 progresses, it is useful to desctibe 
the design of the file system as it currently exists./^ I 

The global participant file (see figures 23 and 24) contains 'ihfon|ia- 
tion on alvL participants who are known to FOjRUM. This information consists 
of the first and last names, pas5;word, activity the person may join, tl}e 
skill ratings, the last time in FORUM, a? Wylell as tie current activity /num- 
ber, the number of times the person has eritered FORUM, the directory ftom 
which ent:ry took place/ etc. A hash tabW is used to lead to a directioij^ 
for fast identification according to a me'chanism, the details of which 
^ 11 'I 

follow. i 

Given a person's global participant number, a linear search down the 
data blocks will yield the corresponding entry. Given the hash value for 
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the name, "this value modulo 11 giv^es the location in the hash table lead- 
ing to the -lookup directory. This directory, in turn, holds thfe relative 
location of the entry. 

The private message file is a two-part structure and. is also global for 
a particular^ user. (See Figure ,25.) It contains a set of message direc- 
tories with information about messages sent and received, .and also a set of 
^directories containing viewing summaries (how many messages the usfer has ac- 
tually seen) . This file enables a user to review and delete private mes- 
sages diat were sent as well Is those received. The file is deleted at the 
end of a session if there are no messages irt> it (i.e., if all have X>een 
deleted) 

The activity file shown in Figures 26 throii^h 27 contains information 
on the structure of the activity, the participant'is and their status rela- 
tive to the activity, and the text of the entries lis^ the activity. This iri- 
^-fonaation is organized into three parts, each with a directory... The con,- 
tej*trs directory shown in Figure 26 points to the information the organizer 

itered v^en the file was first created. This includes the text of the 
parts and the tree-structure description/- It is useful to recall that each 
^t, is a discussion by default. Elicitation of special information is 
^^--si^Jred as a special kind of text entry. ^ 
To each part corresponds a set of thirty-eight information words con- 
- taining the joining and leaving bits, typing bits, and the members of up to 
, thirty-six participants who can be active synchronously in the same part. 

The text entry directory of the activity file is shown in Figure 21, 
The FORUM input buffer is four pages in length (or ^' about 10,000 characters) 
but there is no limit to the length of a file that is submitted into an 
activity, - \ ^ 

Four sub-directories correspond to each part. The main directory indi 
cates who originated the^ entry, at what time, the number of lines, and the 
location of the actuaj, t^xt in the file. The synchronous directory is writ 
ten when the entry is completed, and the review directory is allocated when 
the entry is begun. This mechanism is required to support the transition 
from the asynchronous to the synchronous interaction in a way that remains 
invisible to the user. The monitor directory contains additional informa- 
tion about entries used for analysis of FORUM usage. 
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The activity par.ticipants dixectofy for each activity is indexed by 
the participant's local activity number and contains each user's global par- 
ticipant number, the relative location of the activity schedule, the cur- 
rents participant niimber, the status bits,, the total number of entries the 
user has seen, and some entry statistics. The activity-schedule information 
is designed as a tree structure that mirrors that of the activity and holds 
the corresponding statistics'. (See Figure 28.) 

D. ANALYSIS 

This section concerns itself with the actual operational performance 
of FORUM-5 as a running program ptl the PDP-10 computer at DSC-ISI . These 
statistics, based on release 5 of the program, can be taken in most cases 
as an upper bound both in core size and running time with respect to future 
releases* 

In the TENEX PDP-10 environment, the computer and di^ space are di- 
vided into pages of 512 words of thirty-six bits each. This paging feature 
allows a more efficient use of computer resources since sections of the com- 
puter program need only be brought into core as- needed. In a nonpaged envi- 
ronment, the entire program has to reside in core. 

Release 5 is sixty pages in length and is completely reentrant. These 
sixty pages are divided into eight pages of private memory spiace , ten pages 
of shared files, and the remaining forty-two pages of pure conputer instruc- 
tions. By making the program reentrant in this way, it is possible (under 
the TEN2X operating environment) for users to share most of the program. 
Thus, the first person to use FORUM would need to have the entire sixty 
pages of the progtan). However, the next and following users would only 
need an additional eight pages of private memory space each, as they will 
share the files and computer instructions. 

An important statistic for an interactive program concerns the ratio 
of CPU usage to connect tt©^. In the case of FORUM-5, this ratio is very 
low. In other words, the program can run for many hours while using very 
little computer time. Typical runs of FORUM-5 yield the figure of one min- 
ute of computer time for two hours of conferencing (the corresponding cost^ 
assuming standard industry rates ^ would be $16 for such a conference.) 
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We have obtained specific statistics fqr two users and have averaged 
them over many sessions. User 1 was running release 5 at 30 characters per 
seconi through the network. His CPU/connect time ratio, averaged over 
eleven sessions, is 1/140. User 2 was running release 5 at 240 charactefrs 
per second on a terminal -that was wired directly to the ISI machine. His 
CPU/connect time ratio, averaged^ over twelve sessions, is 1/170. 

Another interesting statistic concerns the size of the files generated 
by FORUM. We have seen in Figure 11 the, growth curves for two Institute 
conferences. The corresponding storage utilization is the following: At 
the time when the statistics were computed^ there were 441 entries in Con- 
ference #1, broken down into 337 publics-entries and 104 private messages. 
The file size was sixty -two pages, of whj^^h the actual text occupied fifty- 
seven pages. There were 520 entries in Conference #2, with 431 public en- 
tries and 89 private messages. The file size was fifty-two pages, with 
forty-six pagers ^of actual text. These figures are reflected in Figure 29. 

We have also performed an analysis of the retrieval effectiveness of 
release 5 in REVIEW operations. The results are shown in Figures 30 and 31. 

These statistics show a fairly constant value of 9 milliseconds per en- 
try in Conference #1 for those retrieval requests that did not require text 
search. For the requests that did require text search (namely, requests 
as REVIEW ENTRIES RE "EXPERIMENTS") , the 'search time is a function of the 
size of the entries and the number of characters in the string to' be matched. 
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Figure 29. Storage Stattstfcs for Two FORUM Conferences 
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Figure 30, Retrieval Statistics for Conference #1 
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Figure 31. Retrieval Statistics for Conference #2 
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